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. The general objective of this study is to assist in 

the iirprovenient of compensatory education programs in Massachusetts 
through modifications of current programs basv°d on evaluations 
specific enough to permit the formulation of concrete recommendations 
for improvement. A 10 percent sample of projects was chosen for study 
as theoretically representative of the total Statewide Title I 
program. Each project was visited an average of between two and three 
times by a trained observer. Additionally, a survey was taken of all 
school district superintendents in April 1969. The findings of the 
study point to four characteristics of compensatory education as 
presently conceived and practiced in Massachusetts, which keep it 
from efficiently producing significant results of a permanent nature; 

u explicit objectives, operationally defined, which deal 
with the basic problems of the disadvantaged child; (2) Lack of sound 
designs for evaluating programs; (3) Lack of model compensatory 
education programs, which demonstrate appropriate curricula and 
effective teaching methods; and, (4) A critical shortage of 
well-trained compensatory education manpower. (Author/JM) 
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FOREWORD 



Evaluating programs of assistance for poor people is relatively 
simple. With the delivery of food, clothing, and medical care, the 
results are observable. Plans can be made to continue the assistance 
and to establish the program on a permanent basis. 

To develop programs for the educationally impoverished is far 
more difficult, and evaluation is even more difficult. The record 
of compensatory education pregrams is unclear; little evidence is 
available to establish their value. Aid must be given, and the results 
must be evaluated. These are the main problems of all who support or 
participate in compensatory education. 

In 1969 the Commonwealth received about $16,000,000 in federal 
support for education of the culturally deprived from Title I of the 
ESEA. The expenditure of these funds to alleviate educational dis- 
advantage is an important activity. It is clear that educators at both 
the local and state levels need assistance in developing their programs 
and in evaluating them. For this reason the Advisory Council engaged 
Dr. Daniel Jordan, Professor of Education at the University of Massachu 
setts, Amherst, to direct a study of Title I and other locally sup- 
ported programs in the Commonwealth which would describe their extent, 
educational soundness, and recommend the way toward validity and 
improvement through a system of evaluation procedures. Dr. Jordan's 



study staff has involved teachers, counselors, psychologists, social 
workers, officials in the State Department of Education and consultants 
from the universities. The rosufting recommendations are clear, 
feasible, and they must be implemented. 

On behalf of the members of the Advisory Council on Education and 
thi; legislators who c.aated it, I present this extensive and needed 
report to the people, the teachers and to the professionals involved 
in combating educational inequality. We urge the Board of Education, 
the teacher preparing colleges— all engaged in the business of over- 
coming educational disadvantage to use the report as a guide and an 
impulse toward more extensive programs. 



Will iam C. Gaige 
Director of Research 
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HOW TO USE THIS REPORT 



This report has been compiled to serve a variety of purposes 
for different people: 

For those wishing a presentation of the essence of the docu- 
ment in brief form, see "Four Critical Courses of Action," (Pink 
Stock) pages 4-18 . 

For those wanting a complete summary of the entire document 
as a basis for planning change, see "Blueprint for Action," (Yellow 
and Pink Stock) pages 1-121 . 

For those wishing to use it as a detailed reference manual 
for planning individual projects, the section, "Analysis of Data 
and Recommendations," pages 130-262 , and materials listed in the 
Bibliography, page 365 , will be useful. Sections on needs assess- 
ment, establishing objectives, and evaluation are particularly 
relevant. 

For those planning in-service and pre-service training programs, 
the section, "Model Programs for Training Compensatory Education 
Personnel," pages 55-100 , may prove useful. 

For those particularly interested in evaluation. Part I of the 
section, "Analysis of Data and Recommendations," pages 130-205 , and 
the material listed in the Bibliography relative to evaluation, 
page 365 , are pertinent. 

Finally, the entire document contains suitable material for use 
in pre-service and in-service training programs for compensatory 
education personnel. The wide margin on each page can be used for 
making notes and recording comments. 



PREFACE 



The past decade has seen an Increased awareness of the ex- 
istence of poverty in the United States, and, accompanying this 
awareness, a greater public concern for understanding and chang- 
ing the social and economic forces that serve to capture and per- 
petuate it generation after generation. This decade has also 
seen the beginnings of new social and political action aimed at 
attacking the causes and the adverse effects of poverty. One of 
the primary targets has been in the area of education. 

Traditionally, and somewhat optimistically, education has 
been regarded as the major means of obtaining social mobility, 
security, and success in the society. But the schools— and the 
public schools in particular— reflect normative values and aspira- 
tions and therefore gear their curricula to those students who 
are in the middle class majority. For the growing minority, the 
children of the poor in particular, the schools have been gener- 
ally ineffective and extraneous. These children come into the 
schools from subcultures that are markedly different from the main- 
stream. They frequently have neither the verbal and cognitive 
skills nor the expectations and motivations that are prerequisite 
to academic success. The schools have been ill -prepared to deal 
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constructively with these children and have, therefore, in effect, 
dismissed them. 

"Compensatory Education" is a relatively new concept. It 
focuses attention upon the various factors that can inhibit learn- 
ing and seeks to "compensate" for the demoralizing and isolating 
effects of economic and social deprivation upon children and their 
families. Its purpose is to provide children from atypical and im- 
poverished homes with the kinds of educational experiences that 
will enable them to function and compete successfully in the larger 
society. 

Much of the recent impetus to the development of compensatory 
education has been provided by Title I of the Elementary and 
Secondary Education Act of 1965 (P.L. 89-10).^ Although later 
amendments have extended the original scope of the Title I program 
to include children of migratory workers, handicapped children, 
and neglected and delinquent children, the principal emphasis of 
the legislation is upon extending educational opportunities through 
local school districts to children living in low-income areas. The 
stated purpose of the program is "to provide financial assistance 
to local educational agencies serving areas with concentrations of 
children from low-income families to expand and improve their edu- 
cational programs by various means (including pre-school programs) 

^ The correct legal reference is actually Title II, Public Law 
81-874 as amended by Public Law 89-10, Title I. 



ERIC 




which contribute particularly to meeting the special educational 
needs of educationally deprived children." (Sec. 201) 

Financially and in terms of participation, Title I is the 
largest federal program to assist education. Each year it has 
been providing approximately one billion dollars nationally and 
serving nearly one million children. Collectively, Massachusetts 
school districts receive over $15 million and provide Title I 
activities for about 100,000 children annually. Currently, Title 
I allocations are determined for each state (and in turn for each 
local educational agency within a state) on the basis of (a) the 
number of children aged five through seventeen from families with 
incomes under $2,000 according to the 1960 census and (b) the num- 
ber of children aged five through seventeen from families with in- 
comes over $2,000 because of Aid to Families with Dependent Children 
(AFDC), under Title IV of the Social Security Act. The total num- 
ber of such children within a given state is then multiplied by one- 
half the state or national average per pupil expenditure, which- 
ever is larger. The $2,000 poverty index was increased to $3,000 
by an amendment (P.L. 89-750) to the original legislation, but a 
subsequent amendment (P.L. 90-247) then reversed this increase by 
stating that the $3,000 figure was not to be used until Title I 
appropriations were large enough to provide maximum grants to all 
eligible agencies on the basis of the $2,000 index. Since each 
year appropriations have remained lower than the maximum authoriza- 



t1ons permitted by the law, the $2,000 figure Is still used In 
the allocation formula. 

The state education agencies are responsible for the admini- 
stration of the program within the states. Entitlements for 
each school district are calculated according to the above formu- 
la. School district personnel must prepare project proposals 
annually to apply for part or all of their entitlements; these 
proposals are reviewed and approved by staff In the state educa- 
tion agencies. Regulations regarding the geographic locations In 
which school districts may spend their Title I funds and the In- 
clusion of children attending non-public schools are designed to 
Insure that the funds do reach areas where there Is the greatest 
concentration of low-income families within each eligible community. 

Evaluation Is a central concern of the Title I program and 
has been since Its Inception. The legislation contains specific 
provisions for evaluations at the local, state, and national levels. 
Section 205 (5) of the Act stipulates that "effective procedures 
Including provisions for appropriate objective measurements of ed- 
ucational achievement will be adopted for evaluating at least annu- 
ally the effectiveness of the programs In meeting the special edu- 
cational needs of educationally deprived children." The legislation 
also requires local school districts to submit the results of their 
project evaluations to the state education agency. In turn, state 
education agencies are to report annually to the U. S. Office of 
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Education, providing information relative to state-wide opera- 
tion of the Title I program. The U. S. Office of Education is 
then required to submit its findings regarding the national im- 
pact of Title I to the Congress and the President. The legisla- 
tion further established the National Advisory Council on the 
Education of Disadvantaged Youth, a group that functions outside 
of the Office of Education to conduct an Independent program 
evaluation which it presents each year directly to the Congress. 

In the Spring of 1968, the U. S. Office of Education initi- 
ated an additional means of gathering evaluative data on a nation- 
al level that would be more specific and more comparable than 
what can be obtained through the fifty state reports. The Nation- 
al Survey of Compensatory Education includes 465 school districts 
selected as a representative national sample. Thirteen Massachu- 
setts school districts are included. Detailed questionnaires are 
administered to principals, central office personnel, and teachers 
of grades 2, 4, and 6 in certain schools within the sample. Indi- 
vidual pupil information including test scores is also gathered for 
a sample of children within these grades. From this effort the 
U. S. Office of Education hopes to develop a nation-wide picture 
of compensatory services, the student populations receiving such 
services, and their influence upon achievement levels. 

Since the beginning of the program in 1965, numerous other pub- 
lic and private organizations have been examining Title I programs 
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and assessment procedures. Some are working independently; 
others are working under contract from the states and the U. S. 
Office of Education. Several of these studies have involved 
Massachusetts school districts or been conducted by organiza- 
tions within the state. Abt Associates in Cambridge, Massachu- 
setts, designed a study for the U. S. Office of Education in 
which they investigated the feasibility of applying cost-effec- 
tiveness analysis to the evaluation of Title I projects. Boston 
College reported on its federally-funded study of the participa- 
tion of non-public school children in Title I programs, and the 
Reading Studies Center of Western Reserve University has pro- 
vided the U. S. Office of Education with a report on Title I 
reading projects throughout the country. These latter two studies 
included some Massachusetts projects in their samples. The USOE 
also contracted with the New England School Development Council 
(NEEDS-NESDEC) to examine the operation of Title I in New England. 
This study developed a statistical description of FY66 Title I 
activity in the region and provided findings and recommendations 
concerning the feasibility of programmatic evaluation and the 
availabil ity of suitable data. 

Background of the MACE Study ; In 1962, the Massachusetts 
General Court empowered a 21 member committee to conduct a compre- 
hensive study of educational practices, policies, and laws within 



the state. The Special Cominission Relative to Improving and Ex- 
tending Educational Facilities in the Commonwealth is informally 
called the Willis-Harrington Commission after its Executive Direc- 
tor, Benjamin C. Willis and its Chairman, Senator Kevin B. Harring- 
ton. The group presented its findings in December, 1964. The 
study^ produced some interesting statistics regarding the e) : int 
of poverty within Massachusetts. As of the 1960 census, all but 
three communities in the state had families with incomes under 
$3,000 (p. 287). Between 25 % and 30% of the total student popula- 
tion was considered to be in need of compensatory education ser- 
vices, including services for the handicapped (p. 288). The Com- 
mission studied the need for extending compensatory education ac- 
tivities and, prior to the existence of the Elementary and Secondary 
Education Act, offered a series of recommendations to the Department 
of Education and to local school districts regarding ways in which 
they might improve the quality and quantity of programs for the dis- 
advantaged child. 

As the Willis-Harrington Commission was completing its broad 
study of Massachusetts education and partially because of the findings 



Quality Education fo r Massachusetts: An Investment in the 

People ^he Commonwealth , Final Report of the Massarhusetts Hoikp 
S pecial Comnlsslon Established to Make an Investigation and Study 
Relative to Improving and Extending Educational Facilities in the 
Commonwealth; Hon. Kevin B. Harrington, Chairman; Benjamin C. Willis, 
Executive Director; June, 1965. 



and recommendations that the Commission was developing, the 
Massachusetts General Court authorized a state program to pro- 
vide funds to public school districts for the support of com- 
pensatory education activities for disadvantaged children. 
Chapter 650 of the Acts of 1964 was approved in July of 1964 
and became effective the following September. The legislation 
provided state funds for reimbursement on a matching basis to 
school districts that developed compensatory education pro- 
jects approved by the Massachusetts Department of Education. 

The total program was small, awkwardly designed, and short- 
lived. After June, 1967, it was not renewed. During its first 
year, fiscal year 1965, the legislature approved only $50,000 
for the program; during its last year, that amount was increased 
to only $100,000. Thus, limited funding meant that few communi- 
ties were able to participate and none could receive more than a 
few thousand dollars. The provision that state matching fund 
reimbursements could be made only after local projects had been 
completed meant that the total operating costs of the approved 
projects had to be encumbered initially In the local budgets. 
This arrangement did not work to the advantage of participating 
school districts. Instead, it added administrative difficulties 
In exchange for meagre financial assistance. By this time, too. 
Title I of the Elementary and Secondary Education Act was pro- 
viding much larger grants to fully fund local projects. As a 



result, in 1967, rather than revise and strengthen Chapter 650, 
the legislature discontinued state support of compensatory edu- 
cation. 

Indirectly, this present study came into being as a result 
of the Willis-Harrington Commission. Among its many other recom- 
mendations, the Commission also urged and the State Legislature 
subsequently established the Massachusetts Advisory Council on 
Education. MACE exists independently from the Department of Edu- 
cation and is responsible directly to the General Court. It 
serves to initiate and sponsor studies in areas that it considers 
particularly critical to Massachusetts education and to provide 
recommendations for future state and local action in these areas. 

In the Fall of 1968, MACE contracted with the School of Edu- 
cation at the University of Massachusetts for a one-year investi- 
gation of compensatory education programs in Massachusetts. This 
document is the final report based on that investigation. 

The first section, "Blueprint for Action," contains a con- 
cise summary of findings followed by recommendations and sugges- 
tions for implementing them. It is available in a separate pub- 
lication for the convenience of those who want a digest of the 
report with a practical orientation. 



BLUEPRINT FOR ACTION 

A SUMMARY OF RECOMMENDATIONS 
FOR IMPROVING COMPENSATORY EDUCATION IN MASSACHUSETTS 



This section functions as a summary of the report on Compensa- 
tory Education in Massachusetts and is published as a separate docu- 
ment for those who have no need for the detailed information of the 
complete report. 

For the busy reader who wants to have a quick grasp of the 
essentials of the full report and yet does not want to read the sum- 
mary in its entirety, the subsection entitled "Four Critical Courses 
of Action; What Can Be Done to Strengthen Compensatory Education in 
Massachusetts," pages 4-18 (pink stock) contains all of the high 
priority recommendations and serves as a digest of the summary. 
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BLUEPRINT FOR ACTION: 

A SUMMARY OF RECOMMENDATIONS 
FOR IMPROVING COMPENSATORY EDUCATION IN MASSACHUSEHS 

INTRODUCTION 



Over 135,000 school children in the State of Massachusetts 
have backgrounds which did not prepare them for successful per- 
formance in traditional school systems. Thousands of similar children 
not yet in school will continue to enter school at some future time 
unprepared and therefore disadvantaged. To guarantee these children 
an equal educational opportunity means that they must be provided 
w’th special learning experiences that will enable them to compen- 
sate for disadvantages created by inadequate preparation. 

For all practical purposes, compensatory education in the 
State is financed by Title I (Elementary and Secondary Education Act 
of 1965) funds. In fiscal year 1968, the State received over $16 
million in Title I funds to finance 466 compensatory education projects 
involving over 100,000 students in 305 school districts. A compar- 
able amount was received for fiscal year 1969. Our study dealt with 



practically every aspect of a ten percent random sample of these 
projects. Based on the findings of the study, forty-eight 
recommendations for improving compensatory education in the 
Commonwealth have been formulated. Those recommendations which 
have been assigned the highest priority define four basic courses 
of action that must be taken if the pressing needs of the State's 
disadvantaged children are to be met. 



FOUR CRITICAL COURSES OF ACTION ; 

WHAT CAN BE DONE TO STRENGTHEN COMPENSATORY EDUCATION IN MASSACHUSETTS 

The findings of our study are consistent with the findings of 
a large number of similar studies on compensatory education and 
on Title I programs in particular. On the one hand, our findings 
indicate an impressive accumulation of experience in working with 
disadvantaged children on the part of hard-working and devoted 
teachers, aides, and administrators and, on the other hand, a grow- 
ing disillusionment and frustration, frequently not readily ad- 
mitted, with compensatory education as currently conceived and 
practiced. The reason for the frustration is clear: this kind of 
education is not producing significant results of lasting value 
in sufficient numbers of students fast enough to deal with a problem 



that has already rea'.ied vast proportions and is still growing 

1 ** 

at an alarming rate . 

Our findings point to four basic characteristics of compensa- 
tory education as presently conceived and practiced in Massachu- 
setts which keep it from efficiently producing significant results 
of a permanent nature: 

(1) Lack of explicit objectives, operationally defined, 
which deal with the basic problems of the disad- 
vantaged child i 

(2) Lack of sound designs for evaluating programs so 
that they can be continually improved; 

(3) Lack of model compensatory education programs which 
demonstrate appropriate curricula and effective 
teaching methods; and, 

(4) A critical shortage of well -trained compensatory 
education manpower. 

All of our recommendations support four basic courses of action 
which are pertinent to these weaknesses and which we believe will, 
if fully implemented, dramatically strengthen the programs in com- 
pensatory education and make them effective. They are: 

(1) Establish appropriate program objectives, opera- 
tionally defined, and center all planning on 
these objectives; 



** Footnotes are numbered consecutively and are contained in 
the section on "Notes and References" beginning on page 101. 
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(2) Establish sound evaluation components in all Title I 
projects for use in systematic modification towards 
program improvement; 

(3) Establish several model compensatory education pro- 
grams which may be adopted with appropriate modifi- 
cation in other localities; and, 

(4) Take steps to fill the compensatory education man- 
power shortage by setting up training programs con- 
sistent with the above three courses of action. 



I. ESTABLISH APPROPRIATE PROGRAM OBJECTIVES 

During the first four or five years of their lives, most 

middle-class children go through a "hidden" curriculum which 

provides for them the kinds of basic learning competencies that 

2 

are prerequisite to successful performance in school. Up to 
the present time, schools have based their curricula, their 
teaching methodology, and their grading and incentive systems 
upon the erroneous assumption that everyone coming into the 
school has had exposure to that "hidden" curriculum and mastered 
it reasonably well. A child growing up in poverty or semi- 
poverty will also be exposed to a "curriculum"— one that enables 
him to survive in his culture, to be sure, but also one that 
does not provide him with the kinds of learning competencies 
prerequisite for successful performance in schools as they are 
currently set up. 





In coming to the school situation, he is clearly at a tre- 
mendous disadvantage when compared to his more affluent peers. 

The school then compounds the disadvantage by giving him learn- 
ing tasks the prerequisites to which he has not yet mastered, 
thereby setting him up for a guaranteed failure. Being stuck 
in such an intolerable and unjust position and being forced to 
accumulate failures over long periods of time generate such 
negative emotional by-products, all associated with the formal 
learning situation, that effective learning within the formal 
context becomes impossible. Since failure in school reduces 
opportunities for attaining future economic security and con- 
tinuing growth and development, both socially and personally, 
the magnitude of this problem approaches incomprehensible dimen- 
sions. Its ramifications are far-flung largely because the 
situation perpetuates itself through a cycle that is difficult 
to interrupt. 

There are approximately 15 million children in the United 
States who find themselves locked in a system that is not help- 
ing, but in many cases making things worse. Compensatory educa- 
tion has come to be regarded as one of the most promising means 
of helping these children, This kind of education is intended 
to "compensate" for the missed "hidden" curriculum. Unfortunately, 
there is a widespread tendency to cast compensatory education 
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into a remedial mold or put it in the form of general enrichment 
activity, neither of which can compensate for inadequate prepara- 
tion for school. Both remedial work and enrichment experiences 
have their place, but if they do not focus on the task of develop- 
ing competent learners, they are apt to have very little permanent 
or even short-term effects . Our data indicate that Title I pro- 
grams in Massachusetts are similar to the variety of compensatory 
education programs prevalent throughout the United States— pro- 
grams which do not focus on developing competent learners and which 
are therefore not being maximally effective.^ We therefore hope 
that the following recommendation will be regarded as urgent and 
critical : 

(34)** THAT THE STATE DEPARTMENT TITLE I OFFICE MAKE THE 
DEVELOPMENT OF EFFECTIVE AND COMPETENT LEARNERS 
THE REQUIRED MAIN OBJECTIVE OF ALL TITLE I PROGRAMS 
AND THAT LOCAL PROJEaS BE GIVEN ASSISTANCE IN 
TRANSLATING THIS MAIN OBJECTIVE INTO SPECIFIC BEHAV- 
IORAL OBJECTIVES RELEVANT TO THEIR OWN PROGRAMS. 

(The characteristics of a competent learner are outlined on 
pages 56-59 of this document.) 

** In the main body of the study, recommendations are numbered 
consecutively, but not in order of priority. These same numbers 
are used to identify the recommendations in this summary so that 
they may be easily referred to in the context of the findings pre- 
sented in greater detail in the section on "Analysis of Data and 
Recommendations," beginning on page 130 of the full report.) 

341 
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In education everywhere there is evidence of a distinction be- 
tween what educators say they propose to do and what they find them- 
selves doing. In compensatory education this is particularly true 
(largely because we have a better notion of what we want to achieve 
than how to achieve it). This is not a matter of willful deception, 
but a problem of inadequate attention to the evaluation process as 
\t relates to objectives and priorities within objectives. 

Stake and Denny have expressed it succinctly: 

Not only must the evaluator report the goals but he 
must indicate the relative importance of the goals. 

Goals are not equally desirable; some have priority 
over others. Different educators will set differ- 
ent priorities, and the same educator will change 
his priorities over time. Priorities are complex 
and elusive, but the evaluation responsibility in- 
cludes the job of representing them. New conceptu- 
alizations and new scaling techniques are needed to 
take a first step toward discharging this responsi- 
bility. 

The great weakness in our present representa- 
tion of goals is that it does not guide the alloca- 
tion of resources. Goals compete for our support, 
for our efforts. Relying on some explicit, or impli- 
cit priority system, those who administer education 
decide among alternative investments, operational 
expenditures, and insurances. Evaluation requires 
an acknowledgement of priori ties. 6 

Not only do the priorities need to be clear, but the ob- 
jectives need to be explicit and operational. Otherwise, they 



cannot be communicated, will be useless as a guide, and can 
easily be changed without being noticed.^*®*® Our findings 
clearly Indicate the need to Implement the following recom- 
mendation within the context of the preceding one: 

(8) THAT THE STATE DEPARTMENT TITLE I OFFICE PUBLISH 

GUIDELINES ON FORMULATION OF PROGRAM OBJECTIVES WHICH 
WILL INCLUDE AN ELABORATION ON THE FOLLOWING SUGGES- 
TIONS: 

A. OBJECTIVES SHOULD BE GENERATED OUT OF ASSESSED 
NEEDS AND BE FEASIBLE IN TERMS OF RESOURCES 
AVAILABLE 

B. OBJECTIVES SHOULD REFLECT A HIERARCHY OF PRI- 
ORITIES SO THAT RESOURCES, TIME, AND PERSONNEL 
CAN BE ALLOTTED ACCORDINGLY 

C. PROGRAM OBJECTIVES SHOULD BE CLEARLY STATED IN 
BEHAVIORAL TERMS THAT ESTABLISH PERFORMANCE 
CRITERIA FOR STUDENTS AND SPECIFIC SUCCESS CRI- 
TERIA FOR THE PROGRAM 

D. PROGRAM OBJECTIVES SHOULD BE DISSEMINATED TO 
ALL STAFF MEMBERS AND BE INCLUDED AS A PART OF 
THEIR PRE-SERVICE AND IN-SERVICE TRAINING SO 
THAT EVERYONE KNOWS HOW HE IS RELATED TO THE 
ACHIEVEMENT OF THE OBJECTIVES 
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In connection with "C" above, it is important to bear in mind 
at least two basic criteria for program success: 

(1) That students achieve at a rate above the norm, and 

(2) That students receiving compensatory education ex- 
hibit achievement levels statistically significantly 
higher than a comparable control group which does 
not have the compensatory treatment. 

Anything less than this will be an indication of program ineffec- 
tiveness.^®* 



II. ESTABLISH SOUND EVALUATION COMPONENTS IN ALL TITLE I PROJECTS 

Once objectives have been specified and the program planned 
around them, there is no way of determining whether or not, or 
to what degree they were achieved without a carefully planned eval- 
uation component. It is clear that good evaluation is the sine 
qua non of program improvement. There is little hope of insuring 
good evaluation unless adequate time and resources are allocated 
for this purpose. Above all, qualified personnel are required. 
Given the scarcity of trained evaluators, it is all the more impor- 
tant for this kind of expertise to be present in the Title I 
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Office. Although the State report for 1968 indicates a grow- 
ing sophistication in evaluation (and we have seen some evidence 
for this), our data nonetheless clearly indicate a great need for 
improvement of the evaluation procedures employed by project 
directors. We therefore recommend: 

(11) THAT THE TITLE I STATE DEPARTMENT OFFICE RETAIN TWO OR 
MORE FULL-TIME PROFESSIONALLY QUALIFIED PROGRAM EVALUA- 
TORS WHO CAN BE ASSIGNED THE RESPONSIBILITY FOR REVIEW- 
ING THIS ASPECT OF ALL PROPOSALS, MONITORING THE EVALU- 
ATION PROCESS OF THE PROGRAMS, AND FOR HELPING TO MOBI- 
LIZE EVALUATION RESOURCES TO ASSIST LOCAL DISTRICTS AS 
NEEDED. 

It is important to note here that one percent of the State 
allocation for Title I can be used by the State for administra- 
tion of programs. In Massachusetts this amounted to $167,965 in 
fiscal year 1968-69. During last year, only $77,663 was used, 
the rest being returned to the federal government. Thus, this 
recommendation is not unrealistic from a financial point of view. 

Since State agencies are frequently not able to compete for 
adequately trained staff, particularly in the area of evaluation, 
we suggest: 



(12) THAT THE TITLE I STATE DEPARTMENT OFFICE ESTABLISH 
CONTRACTUAL AGREEMENTS WITH BUSINESS OR INSTITUTIONS 
OF HIGHER LEARNING TO PROVIDE TRAINING AND/OR CON- 
SULTANT SERVICES TO EVALUATION STAFF MEMBERS ON THE 
LOCAL LEVEL OR ENCOURAGE LOCAL DISTRICTS TO DO SoJ^ 

(13) THAT SPECIFIC ENCOURAGEMENT BE GIVEN TO LOCAL EDUCA- 
TIONAL AGENCIES TO APPOINT PAID EVALUATORS TO TITLE I 
PROGRAM STAFFS AND THAT IT BE MANDATORY THAT THESE 
EVALUATORS BE INCLUDED ON THE PLANNING STAFF. 

(14) THAT THE STATE DEPARTMENT OF EDUCATION ORGANIZE A 
POOL OF UNIVERSITY CONSULTANTS WHO CAN BE DRAWN UPON 
BY LOCAL DISTRICTS FOR ASSISTANCE IN PLANNING. IMPLE- 
MENTING, AND EVALUATING THEIR PROJECTS. 

It should be noted here that the Massachusetts Advisory Coun- 
cil on Education and the Title I Office in the State Department 
have already acted on recommendation 14. Consultants from vari- 
ous institutions of higher learning have been identified and al- 
ready brought together for a discussion of their responsibilities. 
Lists of these consultants and their addresses have been made 
available to all Title I programs. 



'0 

ERIC 



(15) THAT PART OF THE FUNDS FOR TITLE I PROGRAMS SHOULD BE 
'MADE AVAILABLE TO PROVIDE RELEASE TIME FOR POTENTIAL 
TITLE I STAFF MEMBERS FOR PLANNING, EVALUATION, PRE- 
SERVICE, AND IN-SERVICE TRAINING. GUIDELINES SHOULD 
SPECIFY THIS AND SUGGEST VARIOUS KINDS OF ARRANGEMENTS 
FOR DOING IT. 

With the possibility of adequate assistance being offered, it 
becomes reasonable to establish the requirement embodied in the 
recommendati on : 

(16) THAT SOUND EVALUATION DESIGNS BE CONSIDERED A REQUIRED 
PART OF THE PROPOSAL FOR FUNDS AND THAT NO PROJECT BE 
FUNDED IF IT DOES NOT HAVE AN ACCEPTABLE EVALUATION 
DESIGN. 

It is a common practice for administrators to require 
reports of various kinds which are seldom read and rarely used. 
Evaluation reports are no exception and our data show that for 
the most part the basic purposes of evaluation reports (modifica- 
tion towards improvement^^) are frustrated by: 



(a) 



The design of the report forms; 

The medium of the report; 

The pattern of dissemination; and. 

The timing and frequency of dissemination. 
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Rather than being a vehicle for change, evaluation reports are 
frequently viewed as an official opportunity to justify what 
has been done by presenting the program in the most positive light 
possible. This attitude always has an effect on dissemination 
patterns and reduces the utility of reports considerably. We be- 
lieve the following recommendations are essential to the reali- 
zation of the purposes of evaluation: 

(20) THAT THE STATE DEPARTMENT TITLE I OFFICE CREATE AND 
ADOPT A NEW EVALUATION REPORTING SYSTEM, GIVING AHEN- 
TION TO THE USE OF NEW REPORT FORMS, DIFFERENT MEDIA 
FOR different audiences,^® PATTERNS OF DISSEMINATION,^® 
AND FREQUENCY AND TIMING OF DISSEMINATION,^^ ALL 
GEARED TO FACILITATE PROGRAM MODIFICATION FOR IMPROVE- 
MENT. SPECIFICALLY, EVALUATION REPORTS COMING AT THE 
END OF A PROJECT SHOULD BE REQUIRED TO INCLUDE 
CONCRETE RECOMMENDATIONS FOR PROGRAM MODIFICATION, 

OR PRESENT EVIDENCE AS TO WHY THE PROGRAM SHOULD 
NOT BE MODIFIED WHEN REPEATED. 

(21 ) THAT EVALUATION RESULTS OF A PREVIOUS YEAR'S PRO- 
GRAM BE MADE A MANDATORY SOURCE OF INPUT FOR THE 
CURRENT YEAR'S PLANNING. PROPOSALS SHOULD THERE- 
FORE REQUIRE SOME KIND OF EVIDENCE CONFIRMING 
COMPLIANCE. 
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III. ESTABLISH SEVERAL MODEL COMPENSATORY EDUCATION PROGRAMS 



Given the magnitude of the educational problems facing dis> 
advantaged youngsters and the fact that deficits accumulate rapid- 
ly with passing time, it is imperative for methods of compensatory 

18 

education that are highly successful to be identified as soon 
as possible and then be put into operation as models. By provid- 
ing adequate rewards and incentives, these models will be adopted 
in localities where evaluation demonstrates that little success is 
being achieved. Identifying such approaches may require a greater 
investment of resources initially but will pay off in the long run. 
We therefore recommend: 

(42) THAT THE STATE DEPARTMENT TITLE I OFFICE COLLABORATE 
WITH THE BOARD OF HIGHER EDUCATION, SELECTED INSTI- 
TUTIONS OF HIGHER LEARNING AND PROMISING SCHOOL DIS- 
TRICTS IN THE DEVELOPMENT OF SEVERAL CAREFULLY DE- 
SIGNED COMPENSATORY EDUCATION MODELS WHICH CAN BE 
RIGOROUSLY EVALUATED AND RESULTS FROM WHICH CAN BE 
DISSEMINATED TO OTHER PROJECTS. SUCH MODELS SHOULD 
BECOME DEMONSTRATION CENTERS WHERE STUDENT TEACHERS 
MAY BE TRAINED AND WHERE SITE VISITS MAY BE MADE BY 
THOSE WORKING IN COMPENSATORY EDUCATION. 
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In the above reconmendatlon we are referring to the kind of 

evaluation specified by Edward Suchman: 

The key conceptual elements In a definition of eval- 
uation from a methodological point of view are (1) 
a planned program of deliberate Intervention, not 
just any natural or 'accidental' event; (2) an ob- 
jective or goal which is considered desirable or has 
some positive value, not simply whatever change oc- 
curs; and (3) a method for determining the degree to 
which the planned program achieves the desired objec- 
tive. Evaluation research asks about the kind of 
change desired, the means by which this change is to 
be brought about, and the signs according to which 
such change can be recognized. 

The specifications of a suggested model program are presented 
in the section "Model Program for Training Compensatory Education 
Personnel," beginning on page 55. 



IV. TAKE STEPS TO FILL THE COMPENSATORY EDUCATION MANPOWER SHORTAGE 

According to a 1967 Yeshiva University report to the Civil 
Rights Commission, only 3 % of the 15,000 teachers graduating in 1966 
from the ten major institutions that certify public school teachers 
in the United States had received any orientation in teaching disad- 
vantaged children.^^ Yet, it is estimated that 20-30X of the 
children in the nation's schools require compensatory education. 



This general lack of preparation for teaching the disadvan- 
taged is reflected in our data from the sample. We therefore 
recommend : 

(43) THAT IN ORDER TO MEET A CRITICAL MANPOWER SHORTAGE 
IN COMPENSATORY EDUCATION, THE STATE DEPARTMENT OF 
EDUCATION. IN COLLABORATION WITH SELECTED INSTITU- 
TIONS OF HIGHER LEARNING AND PUBLIC SCHOOL SYSTEMS. 

GIVE TOP PRIORITY TO THE ESTABLISHMENT OF MODEL 
PROGRAMS, BOTH PRE-SERVICE AND IN-SERVICE, FOR TRAIN- 
ING A VARIETY OF COMPENSATORY EDUCATION PERSONNEL; 

THAT THESE PROGRAMS BE BASED ON UP-TO-DATE RESEARCH 
FINDINGS CONCERNING LEARNING AND THE KINDS OF EX- 
PERIENCES THAT ARE PREREQUISITE TO THE DEVELOPMENT 
OF COMPETENT LEARNERS, PARTICULARLY AS THESE EXPERI- 
ENCES RELATE TO THE DISADVANTAGED; THAT THEY IN- 
CLUDE MODEL COMPONENTS ON EVALUATION AND CURRICULUM; 

THAT THE PROGRAMS BE SELECTIVE IN WHOM THEY ADMIT 
AND RIGOROUS IN EXTENT AND DEPTH OF TRAINING; AND, 

THAT THEY BE CAREFULLY EVALUATED. 

Please see the section "A Model Program for Training Compensa- 
tory Education Personnel ," page 55, for specifications of a suggested 
model . 



SUMMARY OF STUDY FINDINGS AND SUBSIDIARY RECOMMENDATIONS 

This section contains brief sumnaries of some of the basic 
findings and all subsidiary recommendations. They are presented 
under headings consistent with the observation protocol and 
questionnaire used to collect the data and represent elaborations 
on the high priority recommendations of the previous section. 

The findings are summarized in brief form and therefore are 
usually general rather than specific in nature. Furthermore, 
rather than stressing strong points, they have been phrased in a 
way that highlights the weaknesses to which the subsequent recom- 
mendations pertain. This should not be construed to mean that 
there were no programs with strong features. There were several 
programs that had innovative and imaginative approaches and most 
had a dedicated staff. Some projects are already doing some of 
the things we are recommending. We acknowledge the excellence 
of these projects or aspects of them and know that members of their 
staffs will appreciate the reason for our approach. 
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PART I: PROJECT PLANNING, EVALUATION. AND MODIFICATION 
PLANNING PROCEDURES 

SUMMARY OF FINDimS FR(m SAMPLE OF TITI£ I PROJECTS 
Participants in Planning Process 

* Planning is done largely by administrative personnel 

* Less than 1/5 ot the planning staff for Title I 
programs vere teachers 

* 81% of projects received no university assistance 

* c naaunity organizations rarely involved signifi- 
cantly in planning process 

* Students seldom participated in planning 

* Parents never mentioned as participants in planning 



Meeds Assessment 

* Mo systematic revietf of needs 

* Little attention vas given to establishing priorities 
among needs 

* Three highest ranking needs identified were: 



1. Reading ia^rov&aent 

2. Improvement of self-image 

3. Improv&oent of attitude totfard school 



Planning Time 

* Most felt there to be inadequate lead time for 
planning 

* Congressional appropriation schedules do not co- 
incide with school year cycle and hanq>ers sound 
planning and project iaq>leaentation 

Program Repetition 

* 9 out of 33 projects Here repeated with no revisions 

* Most revisions concerned matters rela^d to personnel 

* 6 of 33 projects indicated they had used the previous 
yearns evaluation in maJtirtg revisions 

Planning of Pre-service and In-service Training of Staff 

* Little evidence of careful planning for steff training 

* When planning did occur, it often did not have a focus 
congruent with objectives 

RECOMMENDATIONS 



There are several partners which must Join hands In providing 
effective compensatory educational services for disadvantaged 



youngsters: tha youngsters themselves and their parents; school 
personnel; and, representatives of the community and Its agen- 
cies and Institutions. The more Involved all members of the 
partnership are In the conception of programs, the better the 
programs are likely to be, not only because there will be many 
useful perspe.;tives on needs and objectives forthcoming from a 
team effort, but also because participation In the creation of 
something tends to Inspire commitment and support for 1t.^^ We 
therefore recommend: 

(1) THAT LOCAL SCHOOL DISTRICTS BE ENCOURAGED THROUGH WHAT- 
EVER APPROPRIATE MEANS TO DEVELOP MORE BALANCED PLANNI.'.’G 
COMMITTEES WHICH WILL INCLUDE TEACHERS, SPECIALISTS, 
PARENTS, COMMUNITY REPRESENTATIVES, STUDENTS, AND EVALU- 
ATORS (BOTH LOCAL AND FROM THE STATE DEPARTMENT). 

However, such team effort takes more time and, as our data 
show, this Is often not available because of unrealistic deadlines 
for submitting proposals and lack of release time from other re- 
sponsibilities on the part of school personnel.^^*^^ We recommend: 

(2) THAT THE STATE DEPARTMENT OF EDUCATION, TITLE I OFFICE, 
STUDY THE PACING OF EVENTS STARTING FROM THE INITIAL 
PLANNING TO THE BEGINNING OF THE PROJECT AND THAT ON THE 
BASIS OF THAT STUDY NEW DEADLINES BE ESTABLISHED FOR (a) 
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SUBMISSION OF PROPOSALS OR PROSPECTUSES AND (b) REVIEW 
AND APPROVAL/DISAPPROVAL OF PROPOSALS SO THAT ADEQUATE 
LEAD-TIME CAN BE MADE AVAILABLE FOR: 

1 . PROGRAM PLANNING INVOLVING COMMUNITY MEM- 
BERS AND PARENTS 

2. PERSONNEL SaECTION AND RECRUITMENT 

3. PRE-SERVICE TRAINING, AND 

4. ORDERING OF SUPPLIES AND EQUIPMENT AND AR- 
RANGING FIELD TRIPS 

IF A GIVEN SCHOOL SYSTEM HANTS TO RADICALLY CHANGE 
ITS PROGRAM, HE SUGGEST THAT THE TITLE I OFFICE CON- 
SIDER INITIATING A PRE-PROPOSAL REVIEW TO AVOID LAST 
MINUTE RtJECTION. 

Many of the deadlines are sotnewhat Inflexible and badly 
timed due to Congressional appropriation schedules. This has 
been documented by any number of studies and represents a seri- 
ous obstacle to effecti;»e program planning and administration.^® 
He therefore recoHinend: 

(3) THAT THE STATE DEPARTMENT OF EDUCATION DETERMINE THE 
OPTIMUM TIME(S) FOR RECEIVING MONIES FROM THE U. S, 
OFFICE OF EDUCATION AND PRESS FOR A REVISION IN U.S.O.E. 
POLICY THROUGH EVERY AVAILABLE CHANNEL USING EVERY 
AVAILABLE MEANS. 
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When pre-service or In-service training Is not carefully 
planned. It tends to be taken over by a concern for administra 
tive details or specific problems as perceived by the staff. 

If training Is related only to problems as they arise, very 
often Important aspects of training are neglected and If It 
Is too Informal, It tends not to be conducive to a disci- 
plined Inquiry and acquisition of important knowledge. With 
the wealth of knowledge accumulating In the area of compen- 
satory education, all teachers should be exposed to It. Al- 
though Independent study should not be discouraged, there 
are advantages to a well planned training program character- 
ized by extensive Interaction among staff members. It helps 
to achieve a cohesiveness and integrity of the project when 
It Is operational, and particularly so when staff members are 
directly involved In the planning of their own pre-service 
and In-service training. For these reasons we recommend: 

(4) THAT PRE-SERVICE AND IN-SERVICE TRAINING BE CON- 
SIDERED AN INTEGRAL PART OF EACH PROJECT VfHICH RE- 
QUIRES CAREFUL PLANNING CONSISTENT WITH THE CURRICU- 
LUM FOR STUDENTS, THE OBJEaiVES OF THE PROJECT, 

AND THE TRAINING NEEDS OF THE STAFF. 

Good programs depend on good planning and good planning 
Involves identification of needs and setting priorities. Our 
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data Indicate that more attention should be given to this as- 
pect of planning. Our reconmendatlon Is: 

(5) THAT THE STATE DEPARTMENT PROVIDE SOME SPECIFIC 
GUIDELINES AND SUGGESTIONS FOR PROJECTS TO FOLLOW 
IN IDENTIFYING NEEDS AND SEHING UP THEIR OWN 
PRIORITIES. 

Deciding how specific needs are to be met constitutes one 
of the greatest challenges In planning. Without the assistance 
of theories concerning learning and the problems faced by the 
disadvantaged— theories which research has begun to demonstrate 
as useful and productive, programs can be planned on a trial 
and error basis only; and. If evaluation is Inadequate, errors 
can never be Identified. Project data show a real lack of the 
use of theory In planning. We therefore recommend: 

(6) THAT TITLE I PROGRAM PLANNERS BE ENCOURAGED TO IDENTI- 
FY AND DOCUMENT A THEORETICAL BASIS FOR THE PROJECT 
CONTENT AND METHOD AS PART OF THEIR PROPOSALS. 

In many cases, planning took little effort because the pro- 
ject was being repeated. Further, our data Indicate that usu- 
ally there war no justification, based on the project's demon- 





strated efficacy, for repeating It. Under this arrangement. In- 
effective, useless, or even harmful elements of projects may be 
repeated. Even If a given activity Is Just useless In Itself, 

It Is stm harmful because It takes the child away from the 

26 

regular classroom where he would be learning something. We 
therefore recommend: 

(7) THAT THE STATE DEPARTMENT TITLE I OFFICE REQUIRE 
DOCUMENTATION FROM SOUND EVALUATION PROCEDURES 
THAT THE PREVIOUS YEAR'S PROJECT HAS BEEN SUCCESS- 
FUL OR SHOWN SUBSTANTIAL PROGRESS BEFORE APPROVAL 
FOR REPETITION OF THE PROJECT IS GRANTED. 

FORMULATION OF PROJECT OBJECTIVES 

SUMMARy OF FINDINGS 

* In general, project objectives were not expressed 
in behavioral terms^^f^^ 

* Success criteria for projects and/or students were 
rarely defined 

* Generally speaking, project objectives were congru- 
ent Hith the needs specified 

* Only a few of the projects had objectives which re- 
flected an awareness of the need for disadvantaged 
youngsters to learn at a rate above the norm 
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RECOMMENDATION 



(Recomnendatlon no. 8 Is a high priority reconmendatlon and 
appears In the section "Four Critical Courses of Action.") 

SELECTION OF PROJECT PARTICIPANTS 

SUMMARY OF FINDINGS 

* Generally speaking, projects are serving the appro- 
priate population, but selection criteria are not con- 
sistent or uniform 

* In a few cases Title I funds support summer programs 
to which anybody may come 



RECOMMENDATIONS 

(9) THAT MORE SPECIFIC GUIDELINES AND ASSISTANCE BE PRO- 
VIDED BY THE STATE DEPARTMENT TITLE I OFFICE TO LOCAL 
SCHOOL DISTRICTS FOR DETERMINING ELIGIBILITY FOR PAR- 
TICIPATION IN PROGRAMS IN ACCORDANCE WITH THE INTENT 
OF TITLE I LEGISLATION AND THAT THE TITLE I OFFICE CON- 
SIDER REQUIRING MORE DETAILED INFORMATION ON CRITERIA 
FOR SELECTING STUDENTS. 

(10) THAT SUMMER PROJECTS BE MORE CAREFULLY MONITORED TO 

INSURE THAT TITLE I FUNDS ARE NOT BEING USED TO FINANCE 



A REGULAR SUMMER SCHOOL WHICH CAN BE AHENDED BY ANY- 
ONE AND WHICH SHOULD BE FINANCED BY LOCAL DISTRICTS. 

PROJECT EVALUATION 

SUMMAPy OF FINDINGS 

* A little less than half the projects reported no evalu- 
ation design 

* Pre-test, post-test was most common design used 

* Control groups were rarely used (only one case in 
the sample) 

* No att&npts were made to measure any characteristics 
of the environment that may have a bearing on learning 

* There was a general lack of communication about Title 
I students from summer projects to nrinter ones 

* 74% of the projects used standardized tests to evalu- 
ate student progress, achievement batteries being the 
most popular 

* Very little testing in areas of self-image and atti- 
tude change,- in spite of the fact that these were 
prominent aspects of program objectives 

* Considerable testing that was done did not pertain di- 
rectly to program objectives 

* Data collected for evaluation purposes were frequently 
not utilized; 22 out of 36 projects made little or no 
effort to analyze data 

* Evaluation procedures were generally unsophisticated and 
were not built into the project as an ongoing process 
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RECOMMENDATIONS 

(Recommendations 11-16 are considered high priority recom- 
mendations and appear In the section "Four Critical Courses of 
Action.") 

33 

Evaluation has always been required for Title I, but too 
loose a definition of evaluation has been applied In approving 
and monitoring projects. Good evaluation requires financial sup- 
port. In many cases more resources than are currently permissi- 
ble may be needed. We recommend: 

(17) THAT THE STATE DEPARTMENT SEEK, THROUGH WHATEVER APPRO- 
PRIATE MEANS, TO HAVE FISCAL POLICIES RELATED TO ALLO- 
CATIONS FOR EVALUATION CHANGED TO ENCOURAGE MORE SUB- 
STANTIAL SUPPORT FOR EVALUATION. 



To upgrade further the quality of evaluation, we recommend: 



(18) THAT SPECIFIC GUIDANCE THROUGH THE TITLE I STATE DEPART- 
MENT OFFICE (WHICH MAY FIND IT HELPFUL TO DRAW UPON 
CONSULTANTS FROM APPROPRIATE UNIVERSITY DEPARTMENTS) BE 
GIVEN TO LOCAL DISTRICTS WHO ARE PLANNING A TITLE I 
PROGRAM ON: 

(a) MODELS OF ACCEPTABLE EVALUATION DESIGNS 
AND PROCEDURES;^® 



WHAT KINDS OF TESTS AND MEASUREMENTS ARE 




J vS 



55 



(b) 



VALIDATED AND APPROPRIATE (PARTICULARLY 
IN THE AREAS OF SELF-IMAGE AND AHITUDE 
CHANGE) TO USE IN CONJUNCTION WITH GIVEN 
PROGRAM OBJECTIVES;^® 

(c) TYPES AND METHODS OF USING UNOBTRUSIVE 
MEASURES; 

(d) HOW TO ANALYZE, USE, AND STORE DATA SO 
THAT THE INFORMATION IS HELPFUL IN INTRO- 
DUCING MODIFICATIONS TO IMPROVE THE PRO- 
GRAM; 

(e) WAYS OF HANDLING EVALUATION IN THE CASE 
OF JOINT OR COOPERATIVE PROJECTS, PARTIC- 
ULARLY THOSE INVOLVING NON-PUBLIC SCHOOLS;^® 
AND, 

(f) PERT CHARTING OR SOME OTHER SIMILAR DEVICE 
FOR SEHING UP AND MONITORING THE EVALUATION 
PROCESS.®® 

Putting theory into practice and ascertaining its efficacy 
over a long period of time is of primary importance. Our data 
indicate that such demonstrations are needed and would be ex- 
tremely useful for ongoing projects. They would undoubtedly 
serve as a powerful stimulus for modifying and improving many of 
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the projects which are repeated annually. We therefore recommend: 

(19) THAT THE TITLE I STATE DEPARTMENT OFFICE CONSIDER 

SEHING UP A SAMPLE OF PROJECTS FOR LONGITUDINAL EVAL- 
UATION OF THE EFFECTIVENESS OF TITLE I PROGRAMS. 

THIS WOULD NECESSITATE DETERMINING THE KINDS OF DATA 
TO BE COLLECTED AND ASSISTING LOCAL DISTRICTS IN 
SEHING UP AN APPROPRIATE SYSTEM FOR COLLECTING AND 
STORING THE DATA. OF PARTICULAR CONCERN HERE ARE: 

THE COMPARATIVE EVALUATION OF PAIRED MODELS OF TITLE 
I PROGRAMS WHICH VARY ON ONE DIMENSION, SUCH AS THOSE 
PROGRAMS SERVING THE SAME AGE GROUP EACH YEAR COMPARED 
TO THOSE FOLLOWING-THROUGH ON THE SAME STUDENTS FOR 
SEVERAL CONSECUTIVE YEARS AS STUDENTS CHANGE FROM ONE 
GRADE TO ANOTHER; THE COMPARATIVE MERITS OF SUMMER VS. 
WINTER PROJECTS; THE COMPARATIVE MERITS OF HIGHLY STRUC- 
TRUED VS. A GENERAL ENRICHMENT, RELATIVELY UNSTRUCTURED 
APPROACH; AND, WAYS OF DETERMINING HOW VERY SMALL ALLO- 
CATIONS OF FUNDS CAN BE MOST EFFECTIVELY USED. 

PROGRAM MODIFICATION 

SUMMARY OF FINDINGS 

* Evaluation reports rarely included recomiendations for 
program modification; evaluation procedures were seldom 
used as feedback system for immediate modification 
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* Evaluation reports were not widely disseminated; few 
teachers received them 

* Title I practices are having an effect on regular 
school teaching methods, but more systematic communi- 
cation is needed 

* The evaluation component of most projects did not un- 
dergo any evaluation Itself, there being a general lack 
of Bvaluation expertise on local staffs 

* There were no cost-effectiveness systems employed in 
the projects 



recommendations 

(Recomnendatlons 20 and 21 are high priority and are contained 
In "Four Critical Courses of Action.") 

(22) THAT THE STATE DEPARTMENT TITLE I OFFICE PROVIDE 
TITLE I PROJECT PLANNERS WITH GUIDELINES FOR SETTING 
UP MODIFICATION PROCEDURES IN RESPONSE TO AN ON- 
GOING FEEDBACK PROCESS MAINTAINED AS A TEACHING 
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STAFF AND ADMINISTRATIVE RESPONSIBILITY. 

(23) THAT PROJECTS BE ENCOURAGED TO INCREASE COMMUNICA- 
TION BETWEEN TITLE I AND NON-TITLE I PERSONNEL IN RE- 
GARD TO SPECIFIC TITLE I CHILDREN SO THAT BEHER CON- 
TINUITY OF PROGRAMMING CAN BE MAINTAINED. 



A substantial portion of educational programming in the pub- 
lic school system goes unevaluated. Yet there is no good reason 
why it, too, should not be evaluated. If it were, it could help 
to provide useful perspectives on Title I programs, while at the 
same time supplying the means for Its change and Improvement. For 
this reason we recommend: 

(24) THAT EVALUATION REPORTS BE DISSEMINATED TO THE REGU- 
LAR SCHOOL SYSTEM'S PERSONNEL AS WELL AS TO ALL MEM- 
BERS OF THE PROJECT STAFF SO THAT ADOPTION OF EFFEC- 
TIVE TITLE I METHODS AND MATERIALS MAY BE ENCOURAGED 
IN THE REGULAR SYSTEM;^^ and, 

(25) THAT THE STATE DEPARTMENT OF EDUCATION BEGIN TO EN- 
COURAGE SCHOOL DISTRICTS TO EVALUATE THEIR REGULAR 
PROGRAMS, DRAWING ON THE EXPERIENCE OF TITLE I PERSON- 
NEL. 

In the 1968 report on Title I compiled by the Title I Office 
of the State Department, a note was made that there was no way to 
"draw conclusions about the relationships between project cost and 
project effectiveness. Yet this is an important part of evalu- 
ation and cannot be ignored. We therefore recommend: 

(26) THAT THE STATE DEPARTMENT GIVE SOME CONSIDERATION TO 
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COST-EFFECTIVENESS^^ AND TO LONG-RANGE PLANNING IN- 
VOLVING THE DEVELOPMENT OF ACCOUNTING SYSTEMS FOR 
TITLE I PROJECTS IN ACCORDANCE WITH NEW METHODS OF 
PROGRAM BUDGETING. 



PART II: PROJECT STAFFING. TRAINING. AND CURRICULUM 

STAFF CHARACTERISTICS. SELECTION. AND RECRUITMENT 

SUMMARY OF FINDINGS 

* 26% of projects (out of 39 from which data were avail- 
able) had teaching experience with disadvantaged children, 
but no specific training congruent with Title I assign- 
ments 

* About half of the project directors assumed that re- 
sponsibility as an added duty (no release time for it) 

* 42% of the projects used teacher aides and/or other 
para-professionals as part of the support staff; such 
staff rarely had any significant amount of training 

* While minority group representation on the staffs of 
programs serving minority groups was given some con- 
sideration, more attention in this area is needed • 

* On the whole. Title I project staffs are comprised of 
devoted educators who have a positive attitude about 
the work they are doing, though attitudes related to 
expectations of pupil performance could be improved 
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RECOMMENDATIONS 

If programming Is to be effective, objectives must be matched 
by resources adequate to carry them out. If resources are scarce 
or limited. It Is more worthwhile to pick one single objective of 
high priority and allocate all available resources to achieve It 
than to spread resources so thinly that nothing Is accomplished. 
Our data Indicate that Insufficient attention has been given to 
this problem. We therefore recommend: 

(27) THAT WHEN PROPOSALS ARE REVIEWED MORE AHENTION BE 
GIVEN TO THE RELATIONSHIP BETWEEN PROGRAM OBJECTIVES 
AND STAFFING PAHERNS WITH PARTICULAR REFERENCE TO 
THE NEED FOR FULL-TIME PROGRAM DIREaORS AND/OR 
REALISTIC AMOUNTS OF RELEASE TIME, BOTH FOR PLANNING 
AND IMPLEMENTATION, PARTICULARLY IN THE CASE OF 
LARGER PROJECTS. 

During the last few years some effort to determine the effec- 
tiveness of teacher aides has been made. The Bank Street College 
of Education study Identified multiple beneflts.^^ Our data Indi- 
cate that we are deprived of some of those benefits because of 
legal restrictions placed on the functions of aides. We recommend: 

(28) THAT THE STATE DEPARTMENT OF EDUCATION CONSIDER THE 
FORMULATION AND INTRODUCTION OF L EGISLATION WHICH 
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WOULD EXTEND THE FUNCTIONS OF A TEACHER AIDE SO THAT 
THESE KINDS OF SUPPORT PERSONNEL CAN BE MORE EFFEC- 
TIVELY USED IN HELPING THE TEACHER TO MANAGE THE 
TEACHINS/LEARNING PROCESS. THESE EXTENDED FUNCTIONS 
SHOULD CERTAINLY INCLUDE, BUT NOT BE LIMITED TO, 
READING TO THE CHILDREN, LISTENING TO THEM READ AND 
CORRECTING THEIR MISTAKES, AND ASSISTING STUDENTS 
GENERALLY IN WORKING WITH ANY KIND OF PROBLEM, ALL 
UNDER THE DIRECT SUPERVISION OF THE TEACHER TO WHOM 
THE AIDE IS ASSIGNED.^®*^^*^®*^® 

Because significant emotional support from staff and atti- 
tudes reflective of positive expectations are so critical to the 
performance of disadvantaged children, having those kinds of 
attitudes and the capacity to give that kind of support should 
be an important selection criterion for Title I staff. Although 
our data do not reveal a critical problem in this area, it still 
needs to be emphasized and we therefore recommend: 

(29) THAT THE STATE DEPARTMENT TITLE I OFFICE FIND WAYS 
OF ENCOURAGING PROJECT ADMINISTRATORS TO HIRE MINOR- 
ITY GROUP MEMBERS FOR TITLE I PROJECTS, PARTICULARLY 
IN THE CASE OF PROGRAMS SERVING POPULATIONS WHICH 
INCLUDE SUCH MINORITY GROUPS AND TO GIVE SERIOUS CON- 
SIDERATION TO ATTITUDES TOWARDS THE DISADVANTAGED ON 
THE PART OF ALL APPLICANTS . 



PRE-SERVICE AND IN-SERVICE TRAINING 



SUMMARY OF FINDINGS 

* Less than half of the projects had pre-service for 
their staff members 

* Over half of the projects reported no in-service 
training 

* f/hat staff training there was frequently did not focus 
directly on project objectives and usually lasted only 
one or two days 



RECOMMENDATIONS 

(30) THAT SCHOOL DISTRICTS BE REQUIRED TO PROVIDE EVIDENCE 
IN THEIR PROPOSALS THAT STAFF MEMBERS HAVE THE EXPERI- 
ENCE NECESSARY TO TEACH IN TITLE I PROGRAMS IN TERMS 
OF THE OBJECTIVES AND REQUIREMENTS OF THE PROJECT AND/ 
OR THAT ADEQUATE PROVISION IS MADE FOR PRE- AND IN- 
SERVICE TRAINING; 

(31) THAT IN CASE OF PROJECTS UTILIZING TEACflER AIDES, 

THEY RECEIVE TRAINING SPECIFIC TO THE ROLES THEY ARE 
EXPECTED TO PERFORM, AND THAT TEACHERS BE TRAINED IN 
HOW TO SUPERVISE AND WORK WITH AIDES;^^ 

(32) THAT STUDY OF THE EVALUATION OF THE PREVIOUS YEAR’S 



PROGRAM BE MADE A REGULAR PART OF THE PRE-SERVICE 
TRAINING OF STAFF MEMBERS OF ANY CURRENT YEAR; AND, 

(33) THAT PRE-SERVICE TRAINING INCLUDE DEVELOPING A THOR- 
OUGH KNOWLEDGE OF THE EVALUATION ASPECTS OF THE PRO- 
JECT AND THE SPECIFIC OBJECTIVES OF THE PROGRAM IN 
TERMS OF BEHAVIORAL OUTCOMES. 

LEARNING HOW TO LEARN- -DEVELOPING EFFECTIVE LEARNERS 

SUMMARY OF FINDINGS 

* Such ed>ilities as recall, comprehension, application, 
analysis, synthesis, evaluation, convergent and 
divergent thinking were required of students in vary- 
ing degrees, but practically nothing was done to 
teach these processes of dealing with information 

* 50% of the projects considered listening, observing, 
following directions, vocabulary and word reason- 
ing, aixl speech as most important, while 

* Recording, attending behavior, test taking skills, 
study habits and visual discrimination skills were 
considered as relatively important, and 

* 25% of the projects listed problem solving, parti- 
cipation in social groups, and information seeking 
behavior as least important 

* No project placed a major emphasis on teaching stu- 
dents hew to learn by focusing on a development of the 
above kinds of skills and capacities 



»^^.ECOMMENDATION 

(The recommendation pertaining to this subsection, no. 34, 
is considered a high priority recommendation and appears in “Four 
Critical Courses of Action," page 8.) 

M0TIVAT.T0NAL ASPECTS OF THE PROGRAM 

SUMMARY OF FINDINGS 

* 45% of projects from which data were available made 
efforts to individualize prescriptions for learning 

* Less than half the projects identified weaknesses 
or strengths in ways that would enable a program to 
be geared to either or both 

* 25% of the projects indicated that they had given 
consideration to students' interests as a means of 
insuring motivation 

* 33% of the projects reported that experiential back- 
ground of students was considered when curriculum 
was planned 

* 72% of the projects took edbility into consideration 
when planning curriculum 

* 74% of projects had no curriculum materials which mads 
favorable reference to ethnic minorities 

* Most of the projects used materials organized in short 
sequential steps to facilitate learning 

* Half of the projects provided for continuous and in?- 
mediate success experiences 
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* 55% of the projects made a conscious use of reward 
and punishment as a means of increasing motivation 

* Less than a third of the projects made any attempts 
to analyze student self-concepts with a view towards 
improving them 

* Games, dramatics, etc,, were used by many projects 
but the motivational potentialities of participation 
in art activities were generally overlooked 

* Practically all projects used a wide variety cf 
special materials 

RECOMMENDATIONS 

Individualization of Instruction Is one of the most basic 
responses to the need for disadvantaged children to achieve at 
a rate above the norm. Much of the Title I Instruction, particu- 
larly In the summer projects, reflected an acceptance of this 
principle. It was also evident that the State Department Title 
I Office had made efforts to hold the line on numbers of children 
being served so that teaching efforts could be Individualized 
as much as possible and not diluted to a point v/here the teach- 
ing approach could not take Individual pupil needs Into considera- 
tion. However, more encouragement for Improving the quality of 
Individualized Instruction Is needed. Few teachers have been 
trained to teach on this basis; yet, to be effective In the ap- 
proach, techniques different from those used In teaching larger 
classes must be employed. We therefore recommend: 



(35) THAT AN INCREASED EMPHASIS BE PLACED ON THE INDIVIDU- 
ALIZATION OF INSTRUCTION, PARTICULARLY DURING THE WIN- 
TER PROJECTS, AND THAT INCLUDING INFORMATION AND PRAC- 
TICA ON HOW TO KiDIVIDUALIZE INSTRUCTION BE ENCOURAGED 
AS PART OF PRE-SERVICE AND IN-SERVICE TRAINING OF 
TITLE I STAFF. 

The motivational and cognitive needs of disadvantaged young- 
sters have direct implications for both curriculum development and 
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teacher training. Our data show that the many considerations 
related to these needs are familiar to most Title I personnel, but 
not thoroughly enough to be translated into curricular changes and 
teaching methods that are maximally effective. It is certain 
that the level of competence required to achieve the objectives of 
compensatory education cannot be attained through a few workshops 
and/or several hours of pre-service or in-service training. How- 
ever, until long-term training programs are developed by universi- 
ties (which have only begun to assume this critical responsibility), 
an improved short pre-service training will have to suffice.®^ We 
suggest: 

(36) THAT THE STATE DEPARTMENT TITLE I OFFICE, POSSIBLY 
IN COLLABORATION WITH PRIVATE OR PUBLIC INSTITUTIONS 
CONCERNED WITH EDUCATION OF THE DISADVANTAGED, PRO- 
VIDE ASSISTANCE TO LOCAL PROJECTS IN DEVELOPING CUR- 
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RICULA THAT ARE BASED ON STUDENT NEEDS, INTERESTS, 
AND EXPERIENTIAL BACKGROUND SO THAT MAXIMUM MOTI- 
VATIONAL SUPPORTS ARE PRESENT WITHIN THE CURRICU- 
LUM; AND, 



(37) THAT PROJECT PLANNERS AND DIRECTORS BE ENCOURAGED TO 
CONSIDER THE MERITS OF THE VISUAL ARTS, MUSIC, DANCE, 

AND THEATRE ARTS AS A MEANS OF MAINTAINING HIGH LEVELS 
OF INTEREST AND MOTIVATION, FOSTERING COGNITIVE AND 
PERCEPTUAL GROWTH, AS WELL AS DEVELOPING AESTHETIC 
SENSITIVITY.®^ 

Since relevance of materials is a supportive factor in 
sustaining motivation, children who belong to minority groups must 
be able to identify with some aspects of the subculture from which 
they come as represented in curriculum materials. Given the 
diversity of the people comprising our society and our commit- 
ment to democracy, such representation is also relevant to children 
who do not belong to a minority group. We therefore recommend: 

(38) THAT LOCAL PROJECTS BE ENCOURAGED TO INVEST IN READ- 
ING AND VISUAL MATERIALS THAT MEANINGFULLY REPRESENT 
MINORITY GROUPS, WHETHER OR NOT THERE ARE MINORITY 
GROUP MEMBERS PRESENT IN THE PROJECTS OR ON PROJECT 
STAFFS. 
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PARENTAL. HOME. AND COMMUNITY INVOLVEMENT 

SUMMARY OF FINDINGS 

* 62% of projects from which data were available had 
not taken into consideration the influence of the 
home on the learning of Title 1 students in the way 
in which the program was set up 

* In over half the projects parents were not actively 
involved 

* 66% of the projects from which data were available 
indicated no community involvement 

RECOMMENDATIONS 

THg Amerlcdn InstItutGs of RGsearch 1n a study designed to 
Identify features of a "successful" compensatory education pro- 
gram listed active parental Involvement as one very Important 
factor.''^ Research has also demonstrated the Influence of sig- 
nificant others, particularly parents, can have on school per- 
formance. Our data show a need to strengthen this aspect of 
Title I programs. The trend to Increase parental and community 
Involvement because of their promise for supporting educational 
objectives effectively Is consistent with our recommendation: 

(39.) THAT PROJECT PLANNERS BE ENCOURAGED TO INVOLVE PARENTS 
AND COMMUNITY IN TITLE I PROJECTS TO A MUCH GREATER 
DEGREE THAN PRESENTLY EXISTS AND THAT PROPOSALS BE RE- 
QUIRED TO SPECIFY THE NATURE OF INVOLVEMENT ON ALL 
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LEVELS: PLANNING, IMPLEMENTATION, AND EVALUATION; 

(40) THAT SCHOOL DISTRICTS BE ENCOURAGED TO CONSIDER EDU- 
CATIONAL AND SOCIAL SERVICES FOR PARENTS AS PART OF 
THE TITLE I PROGRAM AND THAT SUCCESSFUL EFFORTS IN 
THIS AREA BE DISSEMINATED TO OTHER PROJECTS; AND, 

(41) THAT PROJECT DIRECTORS BE MADE RESPONSIBLE FOR DIS- 
SEMINATING INFORMATION ABOUT THEIR PROJECTS TO PAR- 
ENTS AND APPROPRIATE COMMUNITY AGENCIES ON A REGU- 
LAR BASIS. 

(Recommendations 42 and 43 are high priority recommendations 
and can be found on pages 16 and 18 respectively.) 



THE GENERAL RECOMMENDATIONS 

With so many unforeseen and uncertain contingencies on which 
federal funding rests, we recommend: 

(44) THAT THE STATE DEPARTMENT OF EDUCATION BEGIN TO EN- 
COURAGE SCHOOL DISTRICTS TO ASSUME PROGRESSIVELY 
MORE RESPONSIBILITY FOR FINANCING COMPENSATORY EDU- 
CATIONAL SERVICES AS A PART OF THEIR REGULAR SCHOOL 
BUDGETS. 



Our survey data indicate that there are over 30,000 children 
in the Commonwealth who need compensatory services but aren't 
getting them. This represents a growing liability to the State 
which will be a far more costly problem to deal with when these 
children become adults. We recommend: 

(45) THAT LEGISLATION BE ENACTED TO APPROPRIATE STATE FUNDS 
TO SUPPLEMENT THE FEDERAL FUNDS FOR OVER 30,000 
CHILDREN NEEDING COMPENSATORY SERVICES WHO ARE NOT 
NOW RECEIVING THEM AND FOR SETTING UP PROGRAMS TO 
TRAIN EVALUATION SPECIALISTS AND COMPENSATORY EDUCA- 
TION PERSONNEL. 

Many programs have similar objectives and problems. Without 
exchange of information among them, there is a duplication of 
effort and an unnecessary repetition of unsuccessful approaches. 

We therefore recommend: 

(46) THAT THE STATE DEPARTMENT OF EDUCATION HELP TO PROVIDE 
A GREATER DEGREE OF COORDINATION AMONG ALL COMPENSATORY 
EDUCATION PROGRAMS (HEADSTART, FOLLOW THROUGH, UPWARD 
BOUND, TEACHER CORPS, NEIGHBORHOOD YOUTH CORPS, ETC.) 
THROUGH SUCH MEANS AS DISSEMINATION OF INFORMATION, 
SPONSORING CONFERENCES, AND WORKING DIRECTLY WITH THE 
DIFFERENT PROGRAMS TO BRING THEIR PERSONNEL TOGETHER 
FOR CONSULTATION ON MUTUAL PROBLEMS. 
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Our data show that most of the Title I programs include 
children in the early grades. On the strength of many research 
findings which point out how certain early experiences are 
crucial to later learning, we believe that even more emphasis 
should be placed on reaching the very young. We therefore 
recommend: 

(47) THAT THE STATE DEPARTMENT OF EDUCATION ADOPT A 
GENERAL POLICY OF GIVING PRIORITY TO THE PREVENTION 
OF LEARNING DIFFICULTIES RATHER THAN ON REMEDIATION 
AND THAT CONCRETE STEPS BE TAKEN TO EXPAND PRE- 
SCHOOL PROGRAMS AND THE TRAINING OF SPECIALISTS IN 
EARLY CHILDHOOD EDUCATION. 

Finally, because such study documents as this are frequently 
filed and forgotten after a short time, we recommend: 

(48) THAT THE STATE DEPARTMENT OF EDUCATION SET A DATE 
FOR AN ANNUAL REVIEW OF ALL RECOMMENDATIONS UNTIL 
THOSE WHICH ARE FOUND TO BE BOTH ACCEPTABLE AND 
FEASIBLE ARE CARRIED OUT AND THAT SOME APPROPRIATE 
OFFICE OR AGENCY BE CHARGED WITH THE RESPONSIBILITY 
OF THE REVIEW. 



IMPLEMENTATION OF THE RECOMMENDATIONS 

Given the abundant endowment of educational resources In the 
Commonwealth and Its Impressive history and tradition of educa- 
tional leadership, high expectations for action based on these 
recommendations are justified. But action arising out of recom- 
mendations is not likely to occur unless specific people, agencies, 
and institutions see what roles they have to play in effecting 
change and accept responsibility for doing something about it. 

The intent of the following suggestions is to help clarify roles 
and responsibilities of different agencies and institutions In the 
State in regard to the implementation of the recommendations of 
this study. 




State Department of Education ; There is no way to escape the 
conclusions: 

(1) That strong leadership in the State Department of 
Education is absolutely essential to the successful 
implementation of the recommendations of this docu- 
ment, and 

(2) That without implementing these recommendations 
there is no hope of providing equal educational 
opportunities to the State's disadvantaged children. 

No other agency in the State is in such a favorable and strategic 
position to effect educational change. 



Recommendations of 
primary concern to 
the State Department 
of Education: 

Numbers 3, 5, 8, 10 
17, 24, 25, 26, 28, 
29, 43, 44, 45, 46, 
47, 48. 
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One of tha most critical functions of State Department leader- 
ship is to work around the inevitable resistance to the proposed 
changes at whatever levels or positions this resistance may manifest 
itself. A promising way to achieve this is to invest resources in 
those part s of the system that are least resistant or actively 
r.^y for change in a way that will produce new models which can 
be shown t o work better than the old ones . Something that works 
better tends to sell itself and wins acceptance. This is essenti- 
ally the approach we are recommending. To do this, however, will 
require several kinds of initiative and support from the State 
Department of Education: 

1. Allocation of financial resources needed to strengthen 
the position and work of those who are willing and 
able to develop new models of compensatory education, 
lln the case of Title I and other federally funded 
programs, a considerable amount of financial support 
could be made available without even increasing the 
current budget simply by using all that has been 
allocated rather than sending back large unused amounts 
to Washington.) 

2. Coordination of the efforts of those who have a con- 
tribution to make toward the development and refine- 
ment of new models (i.e., professionals working in 
Headstart, Follow-Through, Upward Bound, Neighborhood 
Youth Corps, etc.). 

3. Introduction of the model (s) in selected localities 
where the needs are great and maximum visibility is 
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possible and dissemination of information concern- 
ing successful approaches to programs with related 
objectives. 

4. Formulation, introduction, and support of legisla- 
tion that will be required to legalize some changes 
and provide supplementary financial resources from 
the State to meet the needs of the disadvantaged. 

Particular agencies within the State Department have especially 
significant roles to play. The Title I office is perhaps the most 
important office within the State Department for effecting change 
in compensatory education because it has the power to implement 
a large number of the recommendations directly. Where resources 
needed to carry out a given recommendation are not available from 
the Title I office itself, it can assume the responsibility for in- 
volving other agencies or institutions which can provide whatever 
is required. In many instances, the Title I office can also put 
local projects in touch with sources of needed expertise and encourage 
them to use their budgets in imaginative ways. Since this office is 
responsible for reviewing proposals for funds and approving or dis- 
approving them, it is in a position both to provide guidance and 
encourage compliance with requirements, particularly those con- 
cerned with evaluation (See Appendix VIII, page 343, for a descrip- 
tion of the functions and responsibilities of this office.) 



Recommendations of 
primary concern to 
the Title I office 
of the State Depart- 
ment of Education: 

Numbers 1 through 24 
26 through 43 
45, 47, 48 
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The Board of Higher Education should Insist that schools of 
education in state colleges and universities give some priority 
to training compensatory education personnel and evaluation 
specialists to fill the manpower shortages in these areas. For 
the Title I office to require local school districts to plan and 
carry out adequate compensatory education programs and evaluate 
them when there is little or no trained manpower to do this is 
as unrealistic as it is unjust. In effect, It Is an unenforceable 
requirement and so funds will inevitably continue to be spent on 
programs that are inadequately staffed. Yet, it is morally repre- 
hensible for the State to continue accepting federal funds if it 
will not comply with the requirements of the Title I Legislation; 
and, it cannot comply with the intent of the legislation without 
the highly trained personnel needed to staff the projects. The 
Board of Higher Education can play an important part in getting 
institutions of higher learning to rise to this challenge. 

State Legislature ; The appropriate committees of the State 
Legislature will need to collaborate with the State Department of 
Education and professional organizations in the State in introducing 
legislation that will provide the state funds needed to guarantee 
equal educational opportunities for all disadvantaged children, 
particularly for those many thousands of children not even reached 



Recommendations of 
primary concern to 
the Board of Higher 
Education: 

Numbers 12, 14, 28, 
34, 42, 43, 47, 48. 



Recommendations of 
primary concern to 
the State Legislature: 

Numbers 17, 25, 28, 



44, 45, 47, 48. 








> 



by federally funded programs. This document itself can serve as 
one important source of information to members of the Legislature 
on the current status of compensatory education in the State. It 
is clear that the work to provide compensatory educational services 
to the disadvantaged children of the Commonwealth, initiated by the 
State through the Willis-Harrington Commission, has only begun. 
Carrying out the recommendations of this study will in the final 
analysis depend upon the active support of the Legislature. While 
the cost of carrying out these recommendations will be substantial, 
it will be far more economical than bearing expenses of the unmet 
educational needs of the disadvantaged when they develop into the 
costs of unemployment compensation, crime, delinquency, welfare, 
and the perpetuation of the cycle through the next generation— a 
perpetuation which guarantees a heavy burden on the tax payers in 
the future. 

Colleges and Universities ; University personnel have often 
been quick to criticize the inadequacies of compensatory education 
in the public schools and notoriously slow in developing appropriate 
curricula and training for the kinds of personnel needed to help the 
schools improve their programs. Given the responsibility that state 
colleges and universities have for staffing the public schools, they 
have no reason to wait for the State Department of Education to 
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insist that they provide pre-service and in-service programs for 
training evaluation specialists, compensatory education personnel, 
and specialists in pre-school or early childhood education. In 
addition, a far greater effort to carry out longitudinal research 
on the disadvantaged child and his educational needs has to be 
made and findings from research applied. Such programs on the 
college level would, because of their relevance to critical social 
issues, provide a legitimate means of capitalizing on the genuine 
ideal i sm of many college students — an idealism that is so frequently 
expressed in unproductive ways because there appear to be no 
meaningful alternatives among traditional degree programs. 

Local School Districts ; A number of basic recommendations 
(such as refocusing project thrust by generating objectives con- 
sistent with the goal of developing competent learners, contract- 
ing out the evaluation responsibility to specialists if none are 
on the local staff, and providing a planned pre-service and in- 
service training program) can be implemented by local districts 
and project directors. As model programs are developed, some dis- 
tricts will want to experiment with them in collaboration with the 
educational institutions which have developed them. Local dis- 
tricts can also assume the initiative in getting more local re- 
sources allocated to compensatory education, including those avail- 
able through community organizations, both public and private. 
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Parents ; Like many programs for the disadvantaged, very little 
Title I money goes Into the pockets of the poor themselves. The 
$16 million for Title I in the State is used primarily to pay the 
salaries of middle-class teachers and administrators. Since the 
money has been appropriated to help the disadvantaged, most of whom 
are from low- income families, parents have a right and an obligation 
to insist that these appropriations are spent on programs which are 
effective in helping their children to become competent learners so 
that they can become successful performers in school , prepare for 
careers that will provide them with economic security as adults, and 
guarantee for their children a background free from serious disad- 
vantages. If this is not happening, then disadvantaged children and 
their parents are, in blunt terms, being cheated out of something 
that is rightfully theirs. Most school systems will welcome the 
opportunity for more active parental participation in their compensa- 
tory education programs. Individual parents and parent organizations 
should not lose the opportunity to find ways of supporting the efforts 
the schools are making to brighten the prospects of their children's 
future. 

Educational and Professional Organizations ; Contributing to 
the growth of the education professions by increasing the quality 
and relevance of their training and research programs is a primary 
objective of most educational and professional organizations. Such 
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organizations can use their influence to help obtain the resources 
needed to establish model compensatory education projects and the 
model programs needed to train their staffs. They can do this 
by helping to disseminate information about them and working to 
achieve the support of their members and their representatives 
a.nd colleagues in the Legislature and government agencies. 

Busines s and Industry : Business and industry can support the 

proposals made in this docuim^nt not only by direct financial con- 
tribution, but also by developing new curriculum materials and 
equipment designed to serve the needs of the disadvantaged. They 
can be particularly effective when the materials they produce 
represent an application of research findings concerning the edu- 
cation of the disadvantaged. In many cases, business can undertake 
its own research c;nd speed up the acquisition of important know- 
ledge about teaching the disadvantaged. Business can also provide 
a critical service by developing models for determining cost- 
effectiveness of compensatory education programs. Because the task 
is so great and financial resources always limited, it is doubly 
important to have sound evaluation components in all programs coupled 
with some kind of cost-effectiveness determination so that replanning 
cycles are based on relevant data. 
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MODEL PROGRAM FOR TRAINING COMPENSATORY EDUCATION PERSONNEL 



Universities have been slow to train a variety of compensatory 
education personnel as such. Instead, they have offered a fev/ 
isolated courses on teaching the disadvantaged for those who have 
cared to take them. Given the magnitude of the problem and the 
shortage of manpower, this is a woefully inadequate response. Every 
major study on the disadvantaged underscores the necessity for 
launching a massive attack on the problem, not by piecemeal efforts, 
but by developing full-scale programs staffed by highly trained 
specialists and generalists. 

Since no one type of specialist or generalist can possibly ful- 
fill all the needs of disadvantaged youngsters, particularly where 
there are large numbers to be served, the program we propose is de- 
signed to prepare a variety of personnel who can be employed to work 
as members of a differentiated staff. 

Any program staff (e.g., a Title I program staff) may be differ- 
entiated in a number of different ways, depending on needs, objec- 
tives, and available resources. In whatever way this is done, how- 
ever, the tasks to be performed and the staff roles which they de- 
fine should be directly supportive of the major objective of compensa- 
tory education; development of competent learners who will be able 
to “catch up" and stay "caught up. " 






Characteristics of the Competent Learner ; To grasp the con- 
text of the training program and in order to determine whether or 
not the ultimate objective of the model (developing competent 
learners) is being achieved, it is essential to have a fairly accur- 
ate notion of what such learners are like. How to learn is itself 
a learned process . All learning is not equally germane to that 
process . Generally speaking, the more that is germane to that pro- 
cess a person is able to learn, the more competent he will be as a 
127 

learner . 

An ineffective learner is one whose accumulated learning pre- 
cludes, inhibits, slows up or places limitations on the rate and 
scope of present and future learning. The important point here is 
this: that disadvantaged students simply given information in sub- 

ject matter areas (math, science, biology, etc.) as remedial work 
and perhaps a variety of cultural enrichment experiences to supple- 
ment It, but no information and experience that will enable them to 
master the learning process itself— such students have no hope of 
"catching up" and staying "caught up." Although temporary gains may 
be made through remedial efforts, there is no efficient way of con- 
solidating those gains and converting them into permanent assets 
without mastering the fundamentals of the learning process itself . 

The unique feature of the model is that it prepares teachers to teach 
subject matter areas simultaneously with how to learn every step of 
the way. 
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The following outline of the capacities which constitute learn- 
ing competence Is general and Incomplete It Is presented here 
In brief form only as a means of focusing attention on the kind of 
student the educational program should be helping to develop. Eventu- 
ally these capacities will have to be translated Into specific behav- 
ioral terms so that persons helping to manage the learning process 
will be able to analyze the continual feedback such behavior repre- 
sents for the purpose of Introducing those modifications needed 
to keep the program serving Its basic objective effectively. 

The competent learner Is one who progressively Improves his 
capacity: 

(MOTOR) 1. To coordinate, control, and direct the move- 

ment and position of voluntary muscles 

(PERCEPTUAL) 2. To perceive with reasonable speed and accuracy 

through all sensory modes 

a. Be aware (receptive tQ stimuli) 

b. Discriminate among stimuli on a given 
dimension 

c. Select out Irrelevant stimul 1 and 
attend, to those of Interest to the ac- 
tivity at hand (concentration) 

d. Organize and Interpret stimuli In 
preparation for reaction 

(COGNITIVE) 3. To think 

a. Memorize (store and retrieve Information) 

b. Conceptualize 
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(1) Label events, Ideas, of ob- 
jects (vocabulary develop- 
ment-- this includes handling 
the symbolic systems of langu- 
age and math) 

(2) Categorize o." classify them 
(establish criteria and apply 
them) 

(3) Name categories, identify them, 
and utilize them 

c. Translate from one symbolic form to 
another 

d. Interpret data 

e. Extrapolate and interpolate information 

f. Apply principles 

g. Analyze data 

h. Synthesize data (cognize units) 

i. Speculate (using fantasy, imagination 
and Intuition) 

j. Form and test hypotheses 

k. Transfer knowledge 

(AFFECTIVE) 4. To control and manage feelings and emotions 

1 2Q 

a. Bring feelings under rational control 
(Impulse control, particularly) 

b. Organize feelings (values system forma- 
tion) so they are supportive of actions 
which foster continued growth— curiosity 
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(VOLITIONAL) 



(MORAL) 



(AESTHETIC) 
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and courage, for instance, are in 
part symptomatic of such organiza- 
tion 

c. Develop commitments which give con- 
sistency and efficiency to patterns 
of development and growth (usually 
culminating in habits which maintain 
health at optimum levels and selec- 
tion and pursuit of one's "life's 
work") 

5. To will or intend and carry intentions through 
to conclusions 

a. Initiate action (usually for purpose 
or goal ) 

b. Persevere (break major goal down into 
small units and work towards the achieve 
ment of each one) 

c. Effect closure or consummate action 
(achieve goal) 

6. To be reliable and be responsible for actions 
concerned with human relationships (this rests 
on the developfient of a moral sense which leads 
to behavior and attitudes that are supportive 
of others' growth and attracts reciprocation of 
similar attitudes and supportive action) 

7. To appreciate order 

a. Apprehend order, grasp the Gestalt of 
things 

b. Have a sense of humor (appreciate a 
surprising or unanticipated arrange- 
ment or order of things) 
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c. Create (bring a new level of order among 
parts of things, events, people or ideas) 

d. Strive to understand order in ultimate terms, 
including one's relationship to the universe 
(apprehension of beauty and ultimate purpose) 

It is important to note here that the capacities are all in- 
terrelated and interdependent. The language capacity in particular 
operates on all levels and is necessary, but probably not sufficient, 
to the achievement of full growth on each level. It should also be 
noted that enough research has been carried out on psycho-motor, 
cognitive, and affective development to provide a reasonably sound 
basis for planning and implementation of these aspects of the model. 
Little research has been carried out on the volitional, moral, and 
aesthetic areas. However, some aspects of these areas (psychology 
of intention and perseverance; social or human relation skills; and, 
the kinesthetic, affective and cognitive aspects of the arts, re- 
spectively) have been explored enough to include them as potentially 
fruitful areas for experimentation. 

Structure and Function of a Model Compensatory Education Pro- 
gram : The kinds of personnel to be produced by the program we pro- 
pose will, as indicated earlier, be trained to manage the teaching- 
learning experience (toward the end of developing competent learners) 
most effectively within the framework of an educational system char- 
acterized by a differentiated staffing structure. The following 



orQsnlzatlondl chart rcprosants one possible compensatory educetlon 
model with such a staffing pattern (see page 63).** 

This model and the training program outlined for its staff are 
both equally applicable to the education of non-disadvantaged students. 
The way the model works for disadvantaged children differs from the 
way it works for non-disadvantaged children in that for the former, 
the diagnostic procedures will identify culturally related deficits 
and disadvantages which will then have particular experiences pre- 
scribed to compensate for them. Methods and approaches of handling 
discipline, of involving the home and community, and of developing 

curriculum will vary as the characteristics of the population being 
served vary. 

In the following pages, the main features of the model are speci- 
fied by: 



(1) Designating basic positions in the structure of the 
model ; 

(2) Defining the role associated with each position in 
terms of tasks and the competencies required to per- 
form them; and, 

(3) Prescribing the content of training needed to develop 
those competencies 




M -ik the training program for staff positions 

prepared by the author for ANISA (American 
National ^'^stitutes for Social Advancement) and appears here by their 
permission. ANISA is an incorporated not-for-profit organization de- 
voted to the establishment of educational programs for populations 
which face difficult problems in growth and development. ANISA pro- 
grams are based on a concept of education broadly defined as the 
process by which human potential is releas,ed or developed. 59 
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In this context, POSITION refers to place in a structure; ROLE 
refers to behaviors associated with a given position. The tasks 
specified indicate ROLE or what a person occupying a given POSITION 
should be able to do. The tasks therefore represent the kinds of 
competencies expected of someone occupying any given position. 

In a good working model , positions are arranged in such a way 
(structure) that all the roles (function) achieve objectives (pur- 
pose) in the shortest amount of time utilizing the least amount of 
resources possible (efficiency). A good administrator is therefore 

one who can keep structure and function serving purpos e with effici- 
ency . 

For the sake of brevity, the complete specifications of the 
model are not included here. For instance, the relationships among 
the different staff positions are not spelled out, the specialist 
functions themselves have not been differentiated, nor the question 
of pay scales considered. The degree and kind of differentiation 
possible depends on resources and program objectives. In general, 
the more students served, the more staff differentiation is possible 
and desirable. A diagnostician and evaluation specialist, for 
example, would be more effectively employed if there were several 
subordinate positions to his office to which such functions as 
giving tests, collecting data, punching computer cards, scheduling 
testing times and observation sessions, could be delegated, thereby 
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DIFFERENTIATED STAFFING ARRANGEMENT FOR 
MODEL COMPENSATORY EDUCATION PROGRAM 



Diagnostician and 
Evaluation Sped all st(s) 




secondary school level, supported by assisting 
teachers and aides. 
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freeing the specialist to use his expertise and time in more 
important ways. Furthermore, to pay a specialist's salary for 
services that can be competently performed by an assistant who 
requires less training and/or for clerical work is an uneconomical 
use of funds. 

Selection and Recruitment for Training : In a fully developed 

model, criteria for selecting persons into a training program for 
any given position would be specified. This is extremely important, 
since some people, by virtue of the background they bring to the 
training situation and a variety of personality characteristics they 
possess, are more likely to be successful than others. In other 
words, it is doubtful that training alone can "produce" a model 
staff member; this therefore makes selection an important determi- 
nant of the success of the training program. 

Although a full set of selection criteria for each position is 
not included here, one basic point is worth emphasizing. Stamina 
plus a certain kind of social idealism are important selection 
criteria for this kind of work. Today, the young, who naturally 
tend to have a good deal of stamina, also have a spirit of genuine 
idealism, often with no effective means by which it might be expressed. 
Certainly, protests, sit-ins, and marches are limited in their power 
to inspire a "life's work" in some critical area of social need. Both 
the rigorous training program proposed here and the work for which 






It prepares students require stamina and a sense of Idealism. Such a 
program would attract a new "breed" of teacher and help Infuse public 
education with new blood while at the same time filling a manpower 
shortage and providing a constructive means of channeling the energies 
of college students into work that is relevant, timely, challenging, 
and eminently worthwhile. 

Training a Differentiated Staff for Competence : The model we propose 
can only work If the people occupying all the positions are fully competent 
in their roles. Our program is designed to provide the training that will 
help to insure such competence at reasonable levels. 

A general core of knowledge will be essential to all the roles. As 
these roles are differentiated to serve special purposes, different kinds 
of knowledge and skills will have to be added to the general core. Con- 
tent areas for training are briefly described on pages 87-99. Each descrip- 
tion Is designated by a number and a name. To conserve space and avoid 
lengthy duplication of descriptions, only the designations are used when 
indicating what content areas are prescribed for the training of staff 
members for given positions In the model. Not every staff member needs to 
be prepared In each area to the same degree. The number in parentheses at 
the end of the designations refers to the level of preparation recommended; 
the higher the number, the greater the depth of preparation indicated. For 
Instance, the Master Teacher might need preparation on level (1) in curricu- 
lum theory whereas the curriculum specialist needs preparation on level (3). 



MASTER TEACHER 



Position(s) 



TEACHER* * 



Collaborates with other staff members in the planning for learning; generally 
manages the teaching- learning process; assumes instructional responsibilitie- 
in specific curriculum area (s) (math, music, social sciences, etc.); decides 
on the mode of instruction and selects appropriate media; supervises teachers 
Role (tasks and/or aides; calls on assistance of support staff as needed; participates in 
and compe- home-community-school activities arranged to provide experiential continuity 
tencies) for child; collaborates in evaluation of student performance, teacher perfor- 

mance, and program effectiveness; helps with in-service training of aides and 
students doing their practice as teacher interns; keeps abreast of new develop- 
ments. (The assisting teacher may perform any number of the above roles de- 
pending on the ways the talents and skills of Master Teacher(s) and Teacher(s) 
complement one another.) 



Training and 
Preparation** 



1. Nature of the competent learner (3)*** 

2. Culture and its relationship to perception and learning (1) 

3. Kinds of learning and the conditions of learning (3) 

4. How to plan for learning (1) 

5. Practicum in techniques for developing perceptual speed and acuity (2) 

6. Nature of cognition (3) 

7. Memory (2) 



8. Conceptual behavior (3) 

9. Transfer of learning (3) 

10. The nature of volition and perseverance — increasing the capacity to 
intend and carry something through to completion (1) 

* The Teacher receives a training program similar to that of a Master Teacher, but may not 
achieve a high level of competency in all roles. Of course, with additional training or 
experience, he may become a Master Teacher. 



** See pages 87-99 for descriptions of the training experiences listed. 



*** 



Numbers in parentheses signify depth of 
greater the depth required. 



training needed; the higher the number, the 



n. 

12 . 

13. 

14. 

15. 

16. 
22 . 

23. 



24 . 

25 . 

26 . 

27 . 

28 . 
29 . 

32 . 

36 . 

37 . 

38 . 

39 . 

43 . 

44 . 



Management of feelings and emotions— principles of self-control (1) 
Seminar in motivation (3) 

Reward and punishment and the nature of encouragement (3) 

Handling frustration and failure-identifying and individualizing 
learning experiences around strengths and interests (3) 

Seminar and practicum in learning disabilities (1) 

Anxiety and learning in compensatory education (1) 

tion^modes^ (2)^^^^^^°*' inedia and utilization of different presenta- 



Techniques in the presentation of materials for individualizing in- 
struct1on--utilizing the sequential hierarchy of content arrangement 
and the concrete to abstract approach (3) 

Techniques in developing study skills, study habits, ability to take 
tests and follow direction ^ 



Theories and methods of fostering creative potential (1) 

Theories and techniques for establishing rapport (3) 

The nature of curiosity and techniques for developing a demeanor of 
inquiry (3) 

Compensatory education evaluation (1) 

cation^ (3)^^^^ behavioral cybernetics applied to compensatory edu- 
Techniques of self-evaluation (3) 



Practicum in utilization of non-professional personnel (3) 

Practicum in ^e utilization of members of the peer group as teachers 
and planners (3) r » r 

Curriculum theory and curriculum development (1) 

Training for specific curriculum area (3) 

The nature-nurture controversy (1) 

Race relations (1) 



Position 



ADMINISTRATOR 



Role 



Training and 
Preparation 



Helps to select staff members for the program; collaborates with other staff 
members in planning, implementing, and evaluating the program and staff per- 
formance; generally responsible for administering the program, keening pri- 
orities in mind; budgeting and cost-effectiveness accounting; ordt /ing mater 
ials; supervising facilities; participates in home-community-school affairs; 
makes certain that Master Teacher role has full support from auxiliary staff 
prepares reports on program and disseminates information to staff, students, 
and community; proposal writing and fund-raising. 



1. Nature of the competent learner (2) 

2. Culture and its relationship to perception and learning (2) 

3. Kinds of learning and the conditions of learning (1) 

4. How to plan for learning (3) 

13. Reward and punishment and the nature of encouragement (2) 

17. Theory and practicum in contingency management (1) 

20. Developing moral behavior for supporting learning (1) 

26. Theories and techniques for establishing rapport (2) 

28. Compensatory education evaluation (3) 

31. Tests and measurements for disadvantaged students (1) 

32. Techniques of self-evaluation (1) 

34. Supplementary services in compensatory education (2) 

35. Practicum in preparation of home environments for cognitive stimula 
tion (1) 

36. Practicum in utilization of non-professional personnel (3) 






42. Seminar In administration of compensatory education programs (3) 

43. The nature-nurture controversy (1) 

44. Race relations (3) 

45. Desegregation and Integration: factors In compensatory education (3) 
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Position 



TEACHER OR STAFF AIDE 



Role 1: 

Aides who are 
selected to 
work with 
"things” 



Assist any staff member in any of the following ways: 



filing 

typing 

collecting money 
taking attendance 
keeping records 
duplicating materials 
audio-visual technician 



taking inventory 
report writing 
policing rooms and grounds 
ordering supplies 
grading papers 
driving or transporting 
goods, staff, or students 



Role 2: 

Aides who are 
selected to 
work with 
children 



Assist any staff member in any of the following ways: 



playground supervision 
hall duty 

supervision of study 
story-telling and reading 
field trip chaperones 
recreational activities supervision 
assist in parent-home- community work 



helping to maintain discipline 
supervise lunch room 
work with students in groups or 
individually on learning pro 
jects under supervision of 
staff member 



Much of this will be done as on-the-job training and may be preceded by a 
special pre-service experience related to one or both types of roles. 



Training 



Position 



DIAGNOSTICIAN AND EVALUATION SPECIALIST 



Role 



Training and 
Preparation 



Operate diagnostic clinic; provide student performance information for 
Master Teachers and curriculum specialists; keep performance records on 
each student; participate in program planning with other staff members; 
collaborate with learning disorders specialist in assessing student 
problems and devising solutions; direct the planning of the evaluation 
and the evaluation itself; supervise student interns. 



The following courses are supplementary to a thorough training in tests and 
measurements, research design, and evaluation. 

1. Nature of the competent learner (3) 

2. Culture and its relationship to perception and learning (3) 

3. Kinds of learning and the conditions of learning (3) 

4. How to plan for learning (1) 

5. Practicum in techniques for developing perceptual speed and acuity (3) 

6. Nature of cognition (1) 

7. Memory (1) 

8. Conceptual behavior (1) 

9. Transfer of learning (1) 

10. The nature of volition and perseverance—increasing the capacity to 
intend and carry something through to completion (1} 

11. Management of feelings and emotions— principles of self-control (1) 

12. Seminar in motivation (1) 



13. Reward and punishment and the nature of encouragement (1) 

15. Seminar and practicum in learning disabilities (1) 

28. Compensatory education evaluation (3) 

29. The principles of behavioral cybernetics applied to compensatory edu- 
cation (2) 

30. Techniques in the analysis of child behavior (3) 

31. Tests and measurements for disadvantaged students (3) 

32. Techniques of self-evaluation (3) 

35. Practicum in preparation of home environments for cognitive stimula- 
tion (1) 

Race relations (1) 



44. 



Position 



CURRICULUM AND PROGRAMMING SPECIALIST 



Role 



Training and 
Preparation 



Assist Master Teachers in general progranming and individualizing materials 

"«terials in class; help J?e- 

soeci lisrii^^pltfon^llf^®!^ children at home; work withVv 

creatpn Of A-V materials; supervise programmed instruction 

progr?evaluation supervise student interns; participate in 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 
9. 

10 . 

11 . 

12 . 

18. 

19. 

20 . 



Nature of the competent learner (3) 

Culture and its relationship to perception and learning (3) 

Kinds of learning and the conditions of learning (3) 

How to plan for learning (3) 

Practicum in techniques for developing perceptual speed and acuity (1) 
Nature of cognition (3) 

Memory (3) 

Conceptual behavior (2) 

Transfer of learning (3) 



The nature of volition and perseverance-increasing 
tend and carry something through to completion (1) 



the capacity to in- 



Management of feelings and emotions-principles of self-control (1) 
Seminar in motivation (1) 

Seminar in the development of self-image (3) 



Role of humor, fun, and laughter in educating the disadvantaged (3) 
Developing moral behavior for supporting learning (2) 



21. Practicum in aesthetics in compensatory education (1) 

22. Practicum in selection of media and utilization of different presenta- 
tion modes (3) 

23. Techniques in the presentation of materials for individualizing in- 
struction-utilizing the sequential hierarchy of content arrangement 
and the concrete to abstract approach (3) 

27. The nature of curiosity and techniques for developing a demeanor of 
inquiry (3) 

28. Compensatory education evaluation (1) 

31. Tests and measurements for disadvantaged students (1) 

35. Practicum in preparation of home environments for cognitive stimula- 
tion (2) 

37. Practicum in the utilization of members of the peer group as teachers 
and planners (1) 

38. Curriculum theory and curriculum development (3) 

40. Computer aided instruction for disadvantaged students (3) 

44. Race relations (1) 
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Position 



SPECIALIST IN PSYCHO-LINGUISTICS (AND READING) 



Role 



Training and 
Preparation 



Collaborate with Master Teachers and curriculum specialists in planning 
and implementing programs in language development and reading; work with 
diagnostician and learning disorders specialist in creating special ap- 
proaches for students with particular problems; maintain records on all 
students relative to progress in this area; supervise student interns; 
participate in program evaluation. 



The following are supplementary to a thorough background in psychology and 
reading: 

1. Nature of the competent learner (3) 

2. Culture and its relationship to perception and learning (3) 

3. Kinds of learning and the conditions of learning (3) 

4. How to plan for learning (1) 

5. Practicum in techniques for developing perceptual speed and acuity (3) 

6. Nature of cognition (2) 

7; Memory (2) 

8. Conceptual behavior (2) 

9. Transfer of learning (2) 

11. Management of feelings and emotions— principles of self-control (3) 

13. Reward and punishment and the nature of encouragement (2) 

14. Handling frustration and failure— identifying and individualizing learn- 
ing experiences around strengths and interests (3) 
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15. Seminar and practicum in learning disabilities (1) 

16. Anxiety and learning in compensatory education (1) 

19. Role of humor, ^un, and laughter in educating the disadvantaged (1) 

20. Developing moral behavior for supporting learning (1) 

21. Practicum in aesthetics in compensatory education (1) 

22. Practicum in selection of media and utilization of different presenta- 
tion modes (1) 

23. Techniques in the presentation of materials for individualizing in- 
struction-utilizing the sequential hierarchy of content arrangement 
and the concrete to abstract approach (3) 

24. Techniques in developing studvskills, study habits, ability to take 
tests and follow direction (1) 

26. Theories and techniques for establishing rapport (3) 

27. The nature of curiosity and techniques for developing a demeanor of 
inquiry (3) 

28. Compensatory education evaluation (1) 

29. The principles of behavioral cybernetics applied to compensatory edu- 
cation (3) 

30. Techniques in the analysis of child behavior (1) 

31. Tests and measurements for disadvantaged students (1) 

32. Techniques of self-evaluation (1) 

35. Practicum in preparation of home environments for cognitive stimula- 
tion (1) 

37. Practicum in the utilization of members of the peer group as teachers 
and planners (3) 

39. Training for specific curriculum area (3) 



40. Computer aided instruction for disadvantaged students (1) 

41. Seminar and practicum in psycho-linguistics (3) 

44. Race relations (1) 









Position 



MEDIA SPECIALIST AND COMMUNICATIONS THEORIST 



Role 



Training and 
Preparation 



Assist curriculum specialist and Master Teachers in planning most effective 
ways of presenting materials to be learned; create necessary audio-visual 
tnaterials and supports; work with learning disorders specialist in individual- 
izing programs and experiences for students facing particular problems; ad- 
minister audio-visual services to all staff members; supervise student in- 
terns and/or aides; participate in program evaluation. 



The following training is supplementary to a thorough background in educa- 
tional media and technology: 

1 . Nature of the competent learner (3) 

2. Culture and its relationship to perception and learning (3) 

3. Kinds of learning and the conditions of learning (3) 

4. How to plan for learning (3) 

5. Practicum in techniques for developing perceptual speed and acuity (3) 

6. Nature of cognition (2) 

7. Memory (2) 

8. Conceptual behavior (3) 

9. Transfer of learning (3) 

10. The nature of volition and perseverance-- increasing the capacity to in- 
tend and carry something through to completion (2) 

11. Management of feelings and emotions— principles of self-control (3) 

12. Seminar in motivation (1) 



19. Role of humor* fun, and laughter In educating the disadvantaged (3) 

21. Practicum In aesthetics In compensatory education (2) 

22. Practicum In selection of media and utilization of different presenta- 
tion modes (3) 

23. Techniques In the presentation of materials for Individualizing In- 
struction-utilizing the sequentlel hierarchy of content arrangement 
and the concrete to abstract approach (3) 

24. Techniques In developing study skills* study habits, ability to take 
tests and follow direction (2) 

25. Theories and methods of fostering creative potential (3) 

27. The nature of curiosity and techniques for developing a demeanor of 
Inquiry (3) 

28. Compensatory education evaluation (1) 

32. Techniques of self-evaluation (1) 

35. Practicum In preparation of home environments for cognitive stimula- 
tion (1) 

37. Practicum In the utilization of members of the peer group as teachers 
and planners (2) 

38. Curriculum theory and curriculum development (1) 

40. Computer aided Instruction for disadvantaged students (3) 

44. Race relations (1) 
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Position 



MULTI-ARTS SPECIALIST 



Role 



If as resource In planning and Implementing learning activities cen- 
aesthetic mode of Inquiry (music, theatre arts, dance, 

of different Master Teachers In these areas 
with those specializing In other curricular areas; supervise student In- 
terns and/or aides; participate In program evaluation. 



P^JaratloH'^ Si Irt ^ advanced preparation In two or more of 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 

13. 



Nature of the competent learner (3) 

Culture and Its relationship to perception and learning (3) 
Kinds of learning and the conditions of learning (3) 

How to plan for learning (3) 



Practicum In techniques for developing perceptual speed and acuity (3) 
Nature of cognition (3) 



Memory (2) 

Conceptual behavior (2) 

Transfer of learning (2) 

The nature of volition and perseverance-increasing the capacity to In- 
tend and carry something through to completion (1) 

Management of feelings and emotions— principles of self-control (3) 



Seminar In motivation (3) 

Reward and punishment and the nature of encouragement (1) 
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14. 

19. 

20 . 
21 . 
22 . 

23 . 

25. 

26 . 

27 . 

28 . 
32 . 

35. 

36 . 

37. 

38. 

39. 
44. 



Handling frustration and failure— identifying and individualizing 
learning experiences around strengths and interests (1) 

Role of humor, fun, and laughter in educating the disadvantaged (1) 

Developing moral behavior for supporting learning (1) 

Practicum in aesthetics in compensatory education (3) 

Practicum in selection of media and utilization of different presenta* 
tion modes (1; 

Techniques in the presentation of materials for individualizing in- 
struction--uti 1 izing the sequential hierarchy of content arrangement 
and the concrete to abstract approach (2) 

Theories and methods of fostering creative potential (3) 

Theories and techniques for establishing rapport (1) 

The nature of curiosity and techniques for developing a demeanor 
of inquiry (2) 

Compensatory education evaluation (1) 

Techniques of self-evaluation (1) 

Practicum in preparation of home environments for cognitive stimulation (1) 
Practicum in utilization of non-professional personnel (1) 

and^planners (2^ members of the peer group as teachers 

Curriculum theory and curriculum development (1) 

Training for specific curriculum area (3) 

Race relations (1) 
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Position 


FAMILY-COMMUNITY-SCHOOL LIAISON WORKER 


Role 


Collaborate with other staff members in planning parts of program relative 
to home and community involvement; work with parents and/or relatives in 
preparation of home environments so that they support educational objectives 
follow-up Oil referral services with community agencies; facilitate communi- 
cation among parents, school people, students and community; help to mobil- 
ize home-school-community resources to help solve student problems; super- 
vize student interns and/or aides; participate in program evaluation. 


Training and 
Preparation 


The following courses are supplementary to the kind of general background 
provided traditionally for social workers; 

1. Nature of the competent learner (3) 

2. Culture and its relationship to perception and learning (3) 

4. How to plan for learning (1) 

6. Nature of cognition (1) 

7. Memory (1) 

8. Conceptual behavior (1) 

9. Transfer of learning (1) 

10. The nature of volition and perseverance-- increasing the capacity to in- 
tend and carry something through to completion (1) 

11. Management of feelings and emotions—principles of self-control (1) 

12. Seminar in motivation (3) 

13. Reward and punishment and the nature of encouragement (3) 
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14. Handling frustration and failure— identifying and individualizing 
learning experiences around strengths and interests (3) 

16. Anxiety and learning in compensatory education (1) 

18. Seminar in the development of self-image (3) 

20. Developing moral behavior for supporting learning (2) 

26. Theories and techniques for establishing rapport (3) 

28. Compensatory education evaluation (1) 

32. Techniques of self-evaluation (1) 

33. Seminar and practicum on family resources in compensatory education (3) 

34. Supplementary services in compensatory education (3) 

35. Practicum in preparation of home environments for cognitive stimulation (3) 

36. Practicum in utilization of non-professional personnel (3) 

44. Race relations (3) 

45. Desegregation and integration: factors in compensatory education (3) 
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Position 



Role 



Training and 
Preparation 
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SPECIALIST IN CULTURALLY DERIVED LEARNING DISORDERS 



Collaborate with Master Teacher» diagnostician, and curriculum specialist 
in planning experiences needed to free students from any kind of learning 
problem; supervising and evaluating such experiences; work with family 
liaison person and parents in support of special school program set up to 
remove learning problems; supervise and help train student teachers and/or 
aides. 



1. Nature of the competent learner (3) 

2. Culture and its relationship to perception and learning (3) 

3. Kinds of learning and the conditions of learning (3) 

4. How to plan for learning (3) 

5. Practicum in techniques for developing perceptual speed and acuity (3) 

6. Nature of cognition (3) 

7. Memory (3) 

8. Conceptual behavior (3) 

9. Transfer of learning (3) 

10. The nature of volition and perseverance — increasing the capacity to in- 
tend and carry something through to completion (3) 

11. Management of feelings and emotions — principles of self-control (3) 

12. Seminar in motivation (3) 

13. Reward and punishment and the nature of encouragement (3) 

14. Handling frustration and failure— identifying and individualizing learn- 
ing experiences around strengths and interests (3) 



110 



15. Seminar and practicum in learning disabilities (3) 

16. Anxiety and learning in compensatory education (3) 

17. Theory and practicum in contingency management (3) 

18. Seminar in the development of self-image (3) 

20. Developing moral behavior for supporting learning (2) 

23. Techniques in the presentation of materials for individualizing in- 

sequential hierarchy of content arrangement and 
the concrete to abstract approach (1 ) 

24. Techniques In developing study skills, study habits, ability to take 

tests and follow direction (1) ^ * j 

26. Theories and techniques for establishing rapport (3) 

inquiry*^(l curiosity and techniques for developing a demeanor of 

28. Compensatory education evaluation (1) 

tion*^(3r^*^^^^ behavioral cybernetics applied to compensatory educa- 

30. Techniques in the analysis of child behavior (3) 

31. Tests and measurements for disadvantaged students (2) 

36. Practicum in utilization of non-professional personnel (1) 

44. Race relations (1) 

NOTE: This training will not prepare a person to handle emotionally disturbed cases that 
are extreme, mental retardation, or other forms of organically based disorders. 
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Position 



HEALTH AND/OR MEDICAL SPECIALIST 



Role 



Training and 
Preparation 




Assume responsibility for program planning and implementation related to 
maintenance of health; collaborate with family liaison worker to assure 
that home conditions are conducive to good health; help with referral ser- 
vice; administer first aid when needed; assist teacher in hygiene instruc- 
tion; maintain health records on students, etc. 



The following are supplementary to a standard medical or nursing background: 

2. Culture and its relationship to perception and learning (3) 

5. Practicum in techniques for developing perceptual speed and acuity (2) 
26. Theories and techniques for establishing rapport (3) 

34. Supplementary services in compensatory education (3) 






DESCRIPTIONS OF CONTENTS OF TRAINING EXPERIENCES 



1. NATURE OF THE COMPETENT LEARNER 

This aspect of the training Involves acquiring a relatively thorough understanding of 
the program's main objective In terms of the capacities characteristic of a competent 
learner and how these capacities Insure competence. (Refer to the Description of the 
Competent Learner, page 56.) 9/ 



2. CULTURE AND ITS RELATIONSHIP TO PERCEPTION AND LEARNING 

Culture refers to ways of feeling, thinking, and acting that are transmitted from genera- 
tion to generation. Understanding a "disadvantaged" child's prior capabilities (Includ- 
ing knowledge, attitudes, social skills, etc.) will necessitate understanding how cul- 
ture shapes these prior capabilities. The culture of the middle-class child provides 
him with a "hidden curriculum" that prepares him for the traditional school experience. 
This is particularly true in the case of language development. 61 *76,107 This course 
will give teachers a solid background for understanding the disadvantaged child in broad 
general terms. 



3. KINDS OF LEARNING AND THE CONDITIONS OF LEARNING 

One of the primary conditions of learning is the existence of prior capabilities, con- 
ditions Internal to the learner; there is another category of conditons that are ex- 
ternal to the learner; these are matched in various ways and make up different kinds of 
learning. 60 Growing up in poverty produces a set of prior capabilities different from 
that the middle-class child will bring to the school situation. "Compensatory education" 
should refer to the type of system that matches a new kind of external set of conditions 
to the prior capabilities of the disadvantaged child. 
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4. HOW TO PLAN FOR LEARNING 

This concerns knowledge and application of theories of planning in relationship to 
teaching and learning and includes defining performance criteria, behavioral objec- 
tives, and defining alternative routes to the achievement of instructional objectives 
on different levels. 63, 64, 65, 110 



5. PRACTICUM IN TECHNIQUES FOR DEVELOPING PERCEPTUAL SPEED AND ACUITY 

Students from disadvantaged backgrounds are sometimes known to have reduced perceptual 
spans, speeds, and acuity. Discussion will center primarily on visual and auditory 
modes of sensory reception. Exercises for increasing perceptual capacities (using 
tachistoscopes, projectors, and recorders) are demonstrated and opportunities for 
training disadvantaged youngsters will be provided. 108,109 



6. NATURE OF COGNITION 

This includes a review of the theories of cognitive organization and functioning, with 
an emphasis on the following cognitive processest^l ,72,73,74 convergent processes, 
divergent processes, translation from one symbolic form to another, interpretation pro- 
cesses, foliation and application of principles, analytic processes, synthesis, evalu- 
ation and judgmental processes, and forming and testing hypotheses. A practicum is 
associated with this course in which students are given instruction in how to work with 
any given curriculum materials so that these processes in children are strengthened. 



7. MEMORY 

Certain kinds of experience facilitate storage of information. Forgetting is a special 
case of not being able to retrieve information that is stored. Though less is known about 
the processes of memory and information retrieval than is comfortable to admit, enough 
is known to provide trachers with information that can make a difference in the ability 
to memorize being developed by children whom they teach. 67,68, 69, 70, 87 
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8. CONCEPTUAL BEHAVIOR 

One capacity which readily distinguishes a competent learner from an ineffective one 
is the capacity to form, identify, and utilize concepts. The chief function of con- 
ceptual behavior is to enable the organism to bring a manageable order to the inor- 
dinate complexity of the environment by classifying objects, events, ideas, behavior 
patterns, and feelings. 62, 66 



9. TRANSFER OF LEARNING 

The capacity to transfer knowledge both laterally and vertically is a general factor 
underlying competence in learning. Certain approaches in teaching help to facilitate 
transferability. This is of particular importance in helping disadvantaged children 
“catch up.“77,88 Teachers are given practical exercises in how to induce the transfer 
of learning as a habitual part of instruction no matter what subject is being taught. 

10. THE NATURE OF VOLITION AND PERSEVERANCE— INCREASING THE CAPACITY TO INTEND AND CARRY 
SOMETHING THROUGH TO COMPLETION 

Volition and perseverance are examined in relationship to motivation, aspiration levels, 
sense of personal future, and self-expectations. Practical ways of helping a child to 
strengthen these capacities are discussed. 124, 110 



11. MANAGEMENT OF FEELINGS AND EMOTIONS— PRINCIPLES OF SELF-CONTROL 

Because of frustrations, pressures from injustice and lack of consistent patterns of 
reward and/or punishment, disadvantaged youngsters may find it difficult to control 
impulses and aggressive behaviors. This course provides basic information on how to 
help a student to begin to control himself in constructive ways. 102, 103, 104, 122 
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12. CEMINAR IN MOTIVATION 



One way of conceptualizing a basic problem facing all students needing con^ensatory 
education Is In terms of motivation. Without motivation to attend, to pay attention, 
to become Involved In the learning process, little learning takes place. Students 
who come Into the public school system from a different cultural background will ex- 
perience the structure of values in the public school system as perpetual criticism 
of them for certain "deficiencies," a focus on failure, rather than on support for 
positive efforts made. The seminar deals both with theoretical aspects of motiva- 
tion and the exploration of specific techniques for dealing with practical problems 
of students requiring compensatory education with particular reference to the way In 
which teacher attitude and behc/lor can help foster growth and motivation. The con- 
cept of "competence motivation" Is also examined. 93, 105 



13. REWARD AND PUNISHMENT AND THE NATURE OF ENCOURAGEMENT 

This course reviews the prat .leal applications of research findings concerning reward- 
encouragement and punishment-discouragement. 78,79,83 

HANDLING FRUSTRATION AND FAILURE— IDEffTl EYING AND INDIVIDUALIZING LEARNING EXPERIENC ES 
AROUND STRENGTHS AND INTERESTS 

This course examines the ways In which so many remedial efforts fall because they con- 
centrate on weaknesses where there Is little Interest rather than on strengths. It 
Includes a re-conceptual Izatlon of "failure" as nothing more than a useful trial which 
eliminates one approach and points to a potentially more promising approach to be used 
on a subsequent trial. 



15. SEMINAR AND PRACTICUM IN LEARNING DISABILITIES 

The general psychological aspects of learning disabilities will be reviewed, the rele- 
vant research literature will be discussed, and the specific applications of principles 
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of refnediation will be formulated. The seminar will be limited to 
tnos6 i6drn1n9 dl^dbllltlGS which drc trdCGdbiG to culturdi rdthor 
causes. The practician will Involve the application of contingency 
nlqiies to specific and actual learnlnQ problems of students. 1^5 



a discussion of 
than organic 
management tech- 



ANXIETY AND LEARNING IN COMPENSATORY EDUCATION 

teachers to utilize anxiety as a motivator, to create some 
^ control It, and to utilize It In fostering attention, using 
a and as a means of enhancing learning. This course 

?c . counselors who would like to take advantage of mild states 

students to gain Insights irto their own strengths and weak- 
nesses, and thereby come to know themselves better.113,114,115,116,117 



17. THEORY AND PRACTICUM IN CONTINGENCY ^^ANA6EMENT 

to train contingency managers for dealing with specific 
education where the behavioral pattern of students mitigates 
of attent^n long enough for learning to be possible. The research 
and actual problems will be set for each student to solve 
contingencies. Students specializing In learning disorders will 
rewin In the practicum until they are able to demonstrate their capacity to analyze 

problem and solve It by application of Premack's principle 

bTfiriLefS behavior B, the probability of behavior B can 

te is made contingent upon behavior A). Such techniques may be used 

to break Into student s habit patterns which Impair learning efficiency. 130 



18. SD1INAR IN THE DEVaOPMENT OF SELF-IMAGE 

J®*? of the research literature on the formation 

o ^ ^5? relationship to perception, motivation, emotion, confidence, 
and competence. Perception refers to the organization of sensory Input In terms of 
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past experiences and present needs. The self Is perceived by Itself In terms of the 
same organizational principles. It Is therefore important for teachers and administra- 
tors to understand how their relationship to students and attitudes toward them can 
create dysfunctional self-images, and to know what can be done to modify a self- 
image to make It more functional. Of particular importance is a discussion of the 
self-concept of ability and its relationship to achievement motivation. 92,98,105 



19. ROLE OF HUMOR. FUN, AND LAUGHTER IN EDUCATING THE DISADVANTAGED 

This course examines the cognitive and motivational elements in humor. Practical ways 
of relieving the tediousness of some learning tasks by the injection of humor are dis- 
cussed. 

20. DEVELOPING MORAL BEHAVIOR FOR SUPPORTING LEARNING 

"Morality" refers here to the aspects of behavior concerned with relationships among 
human beings. Certain qualities of a relationship can facilitate or impair learning. 

For instance, a cooperative spirit facilitates learning while a rebellious one tends 
to impair it. Moral behavior is learned like most everything else. Those who are g-, 

cooperative In spirit help others while at the same time attracting support from them. ’ 



21. PRACTICUM IN AESTHETICS IM COMPENSATORY EDUCATION 

This course focuses on the practical ways of utilizing drama, iriusic, art, and dance to 
develop expressive capacities of disadvantaged students, to increase their abilities 
to discriminate among various stimulus properties inherent in the arts, and to heighten 
cognitive development generally. In the past, the arts have been regarded as a nice 
but unessential addition to the curriculum. This course demonstrates how the arts 
can function as a solid core of the curriculum in a wav that will support and serve 
intellectual and affective growth In all other areas. 9 1 
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22* PRACTICUM IN SELECTION OF ME DIA AND UTILIZATION OF DIFFERENT PRESENTATION MODES 

practlcum Is to provide exercise In arranging the relatlonshlp(s) 
between student and media so that communication Is maximally effective. 79,80 ' 



23. 



l ECMNIQUES IN THE PRESENTAT I ON OF MATERIALS FOR INDl VI DUALIZING INSTRUCTION— UTILIZING 
IHE SEQUENTIAL HIERARCHY OF CONT ENT ARRANGEMENT AND THE CONCRETE TO ABSTRACT APPROACH 

enable student-teachers to review any kind of material which students 
th«n in essence of It, break It down Into small units, and arrange 

erro»^s In mastering the material Is greatly 
Mturp^Af fS Information can also be used to Identify the exact 

difficulty a student might have In comprehending a certain concept. The 
tpi^rhpp^r^wJ? "»ter1als Into a sequence of small learning tasks Is crucial 

^e?e th^M Jri^i ! compensatory educational program, particularly 

difficult or abstract. The course also serves as an Introductlor 
material for teaching machines or other kinds of programmed Instruc- «« 
tion and for arranging explanations on a Continuum ranging from concrete to abstract.®^ 



24. TECHNIQUES IN DEVELOPING STUDY SK ILLS. 
DIRECTIONS 



STUDY HABITS, ABILITY TO TAKE TESTS AND FOLLOW 



This Is a short course designed to explain practical means through which students mav 

‘s/"" (This Is partlculari; ?or1?Sde^ 

planning to y>rk In secondary schools or on the college level where much of the learn- 

5'^" The course focuses on how to organise 

material , how to take notes, how to review for exams, how to budget time for studying 
how to follow directions, and how to take exams. scuaying, 

25* THEORIES AND METHODS OF FOSTERING CREATIVE POTENTIAL 

This course Is a practlcum in ways and means of Identifying a creative person and 1n- 
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.90,12 



4 



dividuallzing Instruction In such a way that creativity is not stifled, but, in fact, 
will enhance and support the child's learning efforts in all areas. Such techniques 
will be particularly applicable in the case of the child who shows, for Instance, 
artistic abilities but a disinterest in verbal and mathematical skills. The relation- 
ship of imagination, fantasy, and Intuition to creativity is also explored. “6 



26. THEORIES AND TECHNIQUES FOR ESTABLISHING RAPPORT 

The capacity to establish and maintain rapport with students is a critical charac- 
teristic of an effective teacher, particularly a teacher who is working with disadvan- 
taged students. This course focuses on theories underlying the kinds of human inter- 
actions that lead to rapport and ways of applying theoretical understandings in order 
to achieve rapport. 98 



27. THE NATURE OF CURIOSITY AND TECHNIQUES FOR DEVELOPING A DEMEANOR OF INQUIRY 

This short course focuses mainly on techniques for training students how to get informa 
tion from adults. Since many disadvantaged students are Inexperienced in soliciting 
information from adults and, therefore, simply "tune out" when information which they 
do not understand is presented in the classroom, this course will train a teacher in 
techniques for teaching a student how to ask pertinent questions that will elicit in- 
formation to clear up the difficulty. Research has demonstrated that effective learn- 
ing often takes place when students can be involved by asking questions, since this 
gives them partial control over the flow of information and, therefore, partial control 
of the learning process in general. The psychological nature of curiosity will be ex- 
plored and ways of fostering it examined. 95, 123 



28. COMPENSATORY EDUCATION EVALUATION 

Material covered in this course will include explanations of the difference between re- 
search and evaluation and how they overlap; the relationship between program or teaching 
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objectives and educational needs, and comparison of objectives with actual program 
outcomes; discussion of various kinds of Instruments which might be used In the col- 

relevant to evaluation; ways of treating data; 1n- 
u analysis of data In terms of program objectives as a means of 

building evaluation components Into the general program. 94 



IHE_PR1NC1PLES OF BEHAVIORAL CYBERNETICS APPLIED TO C0MPENS/>T0RY EDUCATION 



^rformance and learning are analyzed In terms of the controlled relationships be- 
"If"®” operator and an Instrumental situation. The concept of the behaving 

or cybernetic system utilizing the processes of sensory 
feedback In the continuous control of behavior Is explored and applications of 
the concept to specific learning situations pertinent to compensatory education are 
discussed. According to behavioral cybernetics, learning as well as other aspects 
of behavior organization are determined primarily by the nature of the feedback- 
wntrol processes available to the behaving Individual. Therefore, practical ex- 
perlence will be 9a1r«d In this course In the designing of learning situations to 

learner. Grading philosophies and examination 
procedures as feedback systems are also examined. 75,101, 121 



TECHNIQUES IN THE ANALYSIS OP CHILD BEHAVIOR 



on the description and ecology of behavior, how to record be- 
havior In Its context, and the utilization of different Instruments for describing 
psycho-social situations and specimens of different kinds of behavior. 



TESTS AND MEASUREMENTS FOR DISADVANTAGED STUDENTS 



IDIi basic theories behind testing programs and offers practical 

selecting or devising tests designed to assist In the collection of data 
app rop riate to a sound determination of whether or not the goals of af\y given part of 
a compensatory education program are being achieved. Students will acquire adequate 



knowledge for evaluating specific teaching efforts and for monitoring the teaching- 
learning process going on In the classroom so that modifications for Improvement 
can be Introduced at any time. The need for careful Interpretation of tests results 
In the light of their built-in cultural biases Is discussed. 118,119,120 



2. TECHNIQUES OF SELF-EVALUATION 

This course Is designed to enable teachers to analyze verbal and non-verbal feedback 
from students as e means of ascertaining their own effectiveness as teachers. Ap- 
proaches to self-observation In the analysis of subjective feelings arising out of 
different situations are discussed and applied. Experience will be gained In the 1n- 
terpretatlon of feedback data, both from students and self-observation, with the aim 
of Identifying modes of behavior that may be tried out as modifications of approaches 
judged to be Ineffective. 



3- seminar and PRACTICUM ON FAMILY RESOURCES IN COMPENSATORY EDUCATION 

The school can no longer be regarded as a socializing agent Independent from the 
families of Its students or the community In which It Is located. This course centers 
u^n w^s and means of Identifying and utilizing family resources to assist In the 
educational program of disadvantaged students. ITI 



SUPPLEMENTARY SERVICES IN COMPENSATORY EDUCATION 

When working with severely disadvantaged populations, compensatory educational pro- 
grams are not complete without supplementary services which help to fulfill more 
basic needs. This short course discusses various kinds of supplementary services 
such as provision of dental care, medical care, vitamin supplements, vaccinations, 
eye care, psychiatric help, and. In some cases, legal assistance. Discussions will 
Include ways and means by which school ptrograms can be Integrated with welfare ser- 
vices and other kinds of assistance from community agencies. 
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35. PRACTICUM I N PREPARATION OF HOME ENVIRONMENTS FOR COGNITIVE STIMULATION 

St experienced by many students from low-income families Is 

the discontinuity between home and school. This course provides a discussion of. 

In, planning with parents and alteration of home 
environment which will help reduce discontinuity and also provide for cognitive 
stimulation appropriate to the development of the children living In the home. 
Preparing home environments is extremely important In helping students who come 
from backgrounds where the middle-class "hidden curriculum" does not exist and, 

foTOanc^in^schoo?^8§'^'^^*^^ experiences prerequisite to successful per- 

36. PRACTICU M IN UTILIZATION OF NON-PROFESSIONAL PERSONNEL 

i° differentiate their staffs, the classroom teacher 

f“PP0^1"9 P®»*sonnel. This practicum focuses on ways of analyzing tasks 
is teaching-learning process 

37. practicum in THE UTILIZ ATION OF MEMBERS OF THE PEER GROUP AS TEACHERS AND PLANNERS 

devoted to training student teachers in the techniques of utilizing 
other class m^bers as teachers and as planners of activities consistent with the 
basic curriculum. Research evidence indicates that peer group members used as teachers 
ila effectively to their peers\ thei^by ““ Mating lea™" 

t?nn ^ TMc but they themselves also improve In their knowledge and motiva- 

is frequently neglected as a classroom resource which could be very effec- 
tive if properly organized and utilized. 11 2 ^ 

38. CURRICULUM THEORY AND CURRICULUM DEVELOPMENT 

theories in curriculum development and Includes a prac- 
ticum In creating curricula on different levels for a variety of purposes. 99. 100, 101 
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39. TRAINING FOR SPECIFIC CURRICULUM AREA 

Mdster Teachers may have one or more areas of expertise in a given curriculum area* 
such as language arts and reading, math, physical science, behavioral science, bio- 
logical science, art, dance, music, theatre arts, literature, technology, etc. 

Basic training in most of these areas would be ordinarily undertaken In the appropri- 
ate department of a university or college. 



40. COMPUTER AIDED INSTRUCTION FOR DISADVANTAGED STUDENTS 

This course will focus on the adaptation of computer education Instruction techniques 
for students who require compensatory education. Special units will be prepared in 
which the computer will be utilized in presentation of information and the explanation 
of any operations in utilizing the Information which the student needs to know. 



41. SEMINAR AND PRACTICUM IN PSYCHO-LINGUISTICS 

This course will cover the basic field of psycho-linguistics Including the following 
aspects: 1 Inguls tic models and functional units of language behavior; mediation theory 
and grammatical behavior; grammatical models and language learning; theory and practice 
of verbal conditioning; covert habit systems; memory transformations of verbal units; 
semantic generalization; and forgetting theory. Experience will be gained In diag- 
nosing psycho-linguistic problems and in basic research techniques related to psycho- 
linguistics. The above list Is not complete and Is only meant to serve as a general 
Indication of the contents of the core. 



42. SEMINAR IN ADMINISTRATION OF COMPENSATORY EDUCATION PROGRAMS 

This seminar will systematically deal with basic problems in the administration of 
compensatory education programs: staff selection; creating differentiated staffing 
patterns for large programs; pre-service and In-service training for staff; creating 
efficient communication channels among staff, students, community people, and parents; 
integration of the compensatory education program with the regular program; and on- 
going modification and evaluation for Improvement. 




43. THE NATURE-NURTURE CONTROVERSY 

This course focuses upon the relationship between this controversy and compensatory 
education. It will Involve a review of the research literature on adopted children, 
studies of twins, the differences In effects of living In Isolation or In Institu- 
tions, and the effects of nursery- school attendance. Related animal research will 
be examined./^ 

44. RACE RELATIONS 

Difficulties among various racial groups In American society have been perpetuated 
by Its major Institutions, Including the school. This course focuses upon several 
aspects of race relations problems: history, the dynamics of prejudice and the 
psychology of attitude change, human rights and the law, and an exploration of the 
means by which educational Institutions and teachers transmit prejudice from one 
generation to another through their attitudes, school policies, and learning mater- 
ials. This course has a practical aspect In that every student participates In 
small encounter groups during which time he Is afforded the opportunity to be con- 
Tronted with his own dttItudGs dnd fGGlInQS dbout dll dspGcts of the rdcldl Issug 
so that he may have a conscious knowledge of how his feelings are altering his per- 
ception. Once this process begins, attitudes are able to be modified and Insights 
can be applied to the teaching-learning situation. 

^5. DESEGREGA TION AND INTEGRATION: FACTORS IN COMPENSATORY EDUCATION 

on desegregation and Integration and discuss the 
ways in which the Institutionalization of discrimination has made compensatory educa- 

TK ” ^^0 public responsibility In a modern democratic society. 

The effects of Integration on educational progress will be examined. This course 
will enable candidates to experience the nature of relevance and Irrelevance as It 
pertains to the teaching and development of materials for black students and those 
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from other racial backgrounds, and to be able to identify either in materials, 
attitudes, and behavior. 126 



NOTE: The above learning experiences designate content areas and do not imply length 
of time required to master them. Presumably this vrauld vary from individual 
to individual, depending upon background, motivation, interest, and the depth 
of mastery desired or required. 
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NOTES AND REFERENCES 



P®oP^® 1'*''® ■*" poverty in this country (Harrington, 
nf*^+hf^+ 7 1 ^U4 ?!i Macmillan: New York, 1962). Havighurst estimates that 15% 
tinn ^ J Popul at ion are disadvantaged, and 30% of the school children popula- 
inn^nli ^ cUies. (Hovighurst, Robert J., "Who Are the Socially Disadvantaged?" 

Education , Summer, 1964.) Others place the estimate as high as 40% of 
the school population being in need of compensatory education. 

^?u ^P^tance, Basil Bernstein's research on how language, as learned while growing 
up in the home, structures and conditions what the child learns and how he learns and ^ 
particularly how this can set limits within which future learning may take place. 

^ Linguistic Development: A Theory of Social 
Ill?noii?:’ Society, edited by A. H. Halsey, et.al .. Glencoe, 



5. 



Dentler's article, "Urban Eyewash: A 

Review of Title I/Year II in The Urban Review , vol. 3, no. 4, February, 1969, pp. 32- 

thrnait°^f^nnn?i^°°lk IJtle I funds showed no improvement in achievement on 

lal SJrLrt ®§ain there were evaluation and data collection problems. 

«Snn ?!fhJ*r^**.^*-^** Malyses of Compensatory Education in Five Sch ool Districts. 

TEMPO, General Electric Company, Santa Barbara, California, March, 1968. Report is 

available through the U. S. Office of Education. 

A review of 150 Title I projects considered to be outstanding reveals the same kind of 
Though much of the learning activity may be related to aspects of becom- 
3U?. ® major thrust, is not present. See Profiles in Oual- 

Outstanding Title I. ESEA. Projects . U. S. Office of Education 
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. stake, R. E. , and Denny, Terry, "Needed Concepts and Techniques for Utilizing More 
Fully the Potential of Evaluation," in Educational Evaluation; New Roles, New Means , 
National Society for the Study of Education Yearbook, LXVIII, Part II, 1969, p. 377. 

"Unfortunately, specifications which are implicit are difficult to communicate to 
others, they are rarely analyzed and clearly revised, and they do not serve as clear 
guides to particular decisions or actions. Implicit specifications may shift without 
the educational worker's being clearly aware of any change, and, because of poor com- 
munication, the attainment of the specifications may defy any attempt at systematic 
appraisal." The author continues, "If the purposes and specifications for education 
are not explicit, then it is possible for them to be altered by social pressures, 
by fads and fashions, and by new schemes and devices which may come and go with momen- 
tary shifts on the educational scene. Implicit purposes are difficult to defend, and 
the seeming vacuum in purpose invites attack and substitution of explicit purposes by 
a constant stream of pressures and pressure groups." 

Excerpts are from the chapter on "Some Theoretical Issues Relating to Educational 
Evaluation," by Benjamin Bloom, in Educational Evaluation; New Roles, New Means , 

National Society for the Study of Education Yearbook, LXVIII, Part II, 1969, p. 29. 

The Guide to Evaluation of Title I Projects , published in October of 1966 by the U. S. 
Office of Education (GPO 1966 0-236-150), outlines clearly the importance of behavioral 
objectives and how to formulate them. See page 8. 

. See also "'School -centered. Waterfront, Compared- to-what?' and Other Educational Objec- 
tives," by Scarvia Anderson, in On Evaluating Title I Programs , Educational Testing 
Service, Princeton, 1966, pp. 23-29. 

. The American Institutes of Research under a contract with the National Advisory Council 
on Education of Disadvantaged Children compared successful and unsuccessful programs. 
They held that'^n improvement In achievement scores was not considered sufficient by 
itself to identify a 'successful program.' The achieved gain had to exceed that made 
by a control group over a comparable period of time, or that to be expected on the basis 
of normative data, and had to be statistically significant." Title 1 - E.S.E.A: A 
Review and a Forward Look - 1969 , Fourth Annual Report of the National Advisory Council 
on the Education of Disadvantaged Children, (GPO 1969 0-331-372), 1969, p. 20. 
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It is a natural sentiment to have reservations about really sound evaluation because 
it will reveal shortcomings and take away excuses for continuing in the same old way. 
Donald Campbell expresses the situation clearly: "It is one of the most characteris- 

tic aspects of the present situation that specific reforms are advocated as though 
they were certain to be successful. For this reason, knowing outcomes has inmediate 
political implication. Given the inherent difficulty of making significant improve- 
ments by the means usually provided and given the discrepancy between promise and 
possibility, most administrators wisely prefer to limit the evaluations to those the 
outcomes of which they can control, particularly Insofar as published outcomes or 
press releases are concerned. Ambiguity, lack of truly comparable comparison bases, 
and lack of concrete evidence all work to increase the administrator's control over 
what gets said, or at least to reduce the bits of criticism in the case of actual fail- 
ure. There is safety under the cloak of ignorance." No doubt this statement speaks 
to administrators of local projects and the Title I Office in the State Department, 
but it is particularly true in our case, since what we advocate (especially in the 
section on training programs), though based on research, nonetheless has never been 
tried out systematically on any significant scale. Yet, it will be critically impor- 
tant for any such efforts to be rigorously evaluated, political vulnerability notwith- 
standing. See D. T. Campbell, "Reforms as Experiments," American Psychologist, vol. 

24, no. 4, April, 1969, p. 409. ^ — 



Massachusetts Evaluation Report on E.S.E.A. Title I Activities, 1968, p. 33. 

In the section on Compensatory Education, the Wlllis-Harrington Report recommends that 
consultant staff should be provided through the Division of Curriculum and Instruction 
essential to unifying, coordinating, and strengthening compensatory education programs 
and services." See page 44. 



Evaluation studies are made to provide a basis for making decisions about alternatives 
and, therefore, in undertaking an evaluation stuciy, one at once addresses himself to 
the questicn of utility." For a useful discussion on the purposes of evaluation as com- 
pared to research, see John Hemphill's chapter on "The Relationship Between Research 
and Evaluation Studies" in the Yearbook of the National Society for the Study of Educa- 
tion, LXVIII, Part II, 1969, p. 189. 






15. Written reports are often ineffective communicators. Translation of reports into 
audio-visual presentations for groups followed by discussion will usually be more 
effective. 



16. Students are rarely recipients of evaluation feedback, yet this can produce greater 
involvement and commitment to program modification, particularly if they can be in- 
cluded in planning the changes in the program. 

17. Most project personnel regarded evaluation as a year-end or end-of-program activity 
rather than as a process of analyzing continual feedback and then making decisions 
about alternative ways to improve the program while the program is still going on. 
Both kinds are needed. The latter has many implications for the timing and frequency 
of reporting. 

18. In Appendix A of the Fourth Annual Report on Title I - 1969, the National Advisory 
Council on the Education of Disadvantaged Children presents an example of comparisons 
made of successful and unsuccessful programs. They conclude, tentatively, that the 
undoubted success of selected programs was "based chiefly on clearly defined objec- 
tives; teaching limited by these objectives; a reducation of competing stimuli; care- 
fully trained teachers; and, a small group approach." 

19. Providing rewards and incentives for model programs Is consistent with the National 
Advisory Council's recommendation that "the U. S. Office of Education should explore 
both administrative and legislative means of rewarding well -designed, successful 
programs and providing incentives for their expansion and implementation by other 
schools." Page 5 of the 1969, Fourth Annual Report on Title I. See also the recom- 
mendation concerning provision of Incentives by the state to school districts (Hillis- 
Harrington Report) Quality Education for Massachusetts . The General Court of the Com- 
monwealth of Massachusetts, 1964, page 43. 



20. Suchman, Edward A., "Evaluating Education Programs," The Urban Review, vol. 3, no. 4, 
February, 1969, pp. 15-16. See also, by the same author, Evaluat1on~Research; Prin- 
ciples and Practices in Public Service and Social Action Programs. New York: Russell 
Sage Foundation, 1967. “ 
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21. Reported in Title I/Year II , U. S. Office of Education, 1968, p. 43, 

22. “Such programs, in our experience, have usually been planned by teachers or curriculum 

experts who are separated from district evaluation personnel both organizationally and 
philosophically.' For fully developed statement, see: Hawkridge, David G., and 
Chalupsky, Altert B., "Evaluating Educational Programs," The Urban Review, vol. 3. no. 
4, February, 1969, p. 8. 

tIJ? ^5® bits-and-pieces approach to the development and organization of 

Title I programs is that there has usually been insufficient planning in advance. This 
failure in planning is partly the result of knowledge of how to plan and partly the 
lack of tiTO to plan." Dyer, Henry S. , "Evaluating Educational Programs," The Urban 
Review, vol. 3, no. 4, February, 1969, p, 10. 

24. See Section entitled "Setting up a planning committee," A Survey of Title I Readi ng 

Projec^, p. 40, published by U.S.O.E., Division of Compensatory Education, November, 
l»o7. 

25. Although poor timing was particularly bad during the first year of Title I, the problem 
still continues. See section "IV. 2 Time of Operation and Duration," The Impact of 
j^tle I; ^sessment Program for New England , New England Educat1onal~Data Systems, 
Decemwr, i967, p. 59. See also the statement of the National Advisory Council on the 
Education of Disadvantaged Children, p. 7, in their report to the President, January, 



26. "Unfortunately, the failure to consider research and evaluation as an integral component 
Of the Mucational system has resulted in a sequence of activities which virtually guar- 
antees tlie vocal findings characteristic of Title I and other compensatory education- 
al • • • Mnile proposals to obtain funding may hav? reflected contributions from 

trained evaluators, these good intentions have been forgotten often or severely compro- 
mised once the funds are obtained and the time comes for detailed program planning. As 
a cons^uencj, non-measurable objectives went unchallenged while evaluators contented 
themselves with easily obtainable data of questionable relevance." See "Evaluating 
Educational Programs," by Hawkridge and Chalupsky, in The Urban Review, vol. 3. no. 4. 
February, 1969, p. 8. 
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27. 


State Department Title I Office recently held a number of conferences at which time 
they announced to Title I project directors and planners that they will require this 
kind of documentation for proposals being submitted beginning summer, 1970. There* 
fore, this recommendation is in the process of being implemented now. 


28. 


Wilkerson, Doxey, "We Must Define Behavioral Goals," Report of Conferences on Improving 
the Education of Disadvantaged Children, U.S.O.E., 1969, p. 27. 


29. 


Johnson, Ray A., "Writing Performance Objectives," A Guide to Evaluation: Massachusetts 

Information Feedback System for Vocational Education, Massachusetts Department of Educa- I 
tion. Division of Research and Development, September, 1969, p. 23. 


30. 


The National Council has expressed a similar concern in regard to projects throughout 
the country. See Report of the National Advisory Council on the Education of Disadvan- 
taged Children, U. S. Office of Education (GPO 911-478), March, 1966, p. 17; and Fourth 
Annual Report of the Council, 1969, p. 43. 


31. 


Guidelines Title I of E.S.E.A. of 1965, Department of Education, Bureau of Elementary 
and Secondary Education, Boston, Massachusetts, July, 1968, p. 2. 


32. 


See memorandum from the U. S. Office of Education dated June 14, 1968, on the subject 
of "Misuse of Title I Funds by Supplanting State and Local Funds." A copy of this memo- 
randum nuy be found in the Title I Guidelines, p. 17. (See previous reference.) 


33. 


See Title I Guidelines, Section J on Evaluation, p. 22. 


34. 


It should be noted that E.S.E.A. Title III (PACE) brings about $5 million into Massachu- 
setts annually as opposed to the $16 million provided by Title I. Title III permits the 
State agency a much larger administrative budget (up to 5X as opposed to IX). If Title 
I projects are to have well -designed evaluation programs, more staff support in this 
area will be needed. 
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35. For example, many new designs, such as the regression discontinuity design, have 
begun to appear, several of which should be made known and used, particularly in the 
case of the evaluation of model programs. See the section on Regression Discontinuity 
Design In the article "Reforms as Experiments," by Donald I. Campbell, published In 
the American Psychologist , vol. 24, no. 4, April, 1969, p. 419. This design has 
direct relevance to the evaluation of programs for the disadvantaged. 

36. The Society for the Psychological Study of Social Issues (SPSSI) has published a 
special supplement. Guidelines for Testing Minority Group Children , which appears In 
the Journal of Social Issues , vol. XX, no. 2. 1964. It is available from SPSSI, 

P« 0. Box 1248, Ann Arbor, Michigan. Collection and dissemination of these kinds 
of publications would make a good beginning. This recommendation parallels the 
recommendation of the National Advisory Council on the Education of Disadvantaged 
Children that: "Professional educators and social scientists should intensify a re- 

view of current achievement tests to further reduce 'culture bound' components that 
ai^ biased against the disadvantaged child and conceal Indications of his true, latent 
ability; and, that these professionals should also move beyond purely cognitive achieve- 
ment tests and Into other realms — self-concept, creativity, motWatlon, behavior— 
where compensatory education may have equally Important long-range results." Fourth 
Annual Report of the National Advisory Council on the Education of DisadvantagecT 
Children, Title I - E.S.E.A; A Review and a Forward Look - 1969 (GPO 0-331-373), p. 5. 

37. Webb, Eugene T., et.al. . Unobtrusive Measure: Nonreactive Research In the Social Sci- 

ences. Rand McNally & Company, Chicago, 1966. 



38. The National Advisory Council on the Education of Disadvantaged Children has expressed 
concern for non-public school participation. They recommend that "the U. S. Office of 
Education should continue to urge the Involvement of non-public school officials in the 
planning and evaluation of Title I programs." See whole section on "Participation of 
Non-public School Children," pp. 5-6 of Fourth Annual Report, Title I, 1969. 

39. Cook, Desmond, Program Evaluation and Review Technique; Applications I n Education, 

U. S. Office of Education, 1966. 




133 



! 



I 



40. Some writers make a useful distinction between feedback and appraisal. "The pur- 

pose of the feedback is to enable the teacher to make wise judgments about what to 
do next in the classroom; the purpose of the appraisal is to describe some state of 
need, readiness, or ability on the part of the child. These purposes are entirely 
different and therefore the fact that they are achieved through different procedures 
seems reasonable. These differences may be noted: (a) In feedback, the decision 

about what data to collect can be finally made only at the moment of collection, 
whereas, in appraisal, the decision can be made independently of the situation. 

(b) In feedback, the object under scrutiny is the activity of a complex system, where- 
as, in appraisal, it is an aspect of the personality structure of an individual, (c) 

In feedback, the categories must be useful to the teacher and usually will be expressed 
in her vocabulary, whereas, in appraisal, the categories should fit coherent theory and 
are often intelligible only to the researcher or some other non-participant." See 
Herbert A. Thelen, "The Evaluation of Group Instruction," in Educational Evaluation : 

New Roles, New Means, National Society for the Study of Education Yearbook, LXviii, 
Parti 1, IMi^^TTg. 

41. "Title I is designed to benefit poor children. Somewhat paradoxically, however, the 
programs made possible by Title I are seriously challenging traditional educational 
practices and introducing new techniques that promise to benefit fortunate children as 
well. In time, the major reforms now underway in low-income schools may become ac- 
cepted priorities for all schools." Title lAear II . The Second Annual Report of 
Title I of the E.S.E.A. 1965, U. S. Office of Education, 1968, p. 3. For more specific 
details see whole section on "Catalyst for Change" from which above quote is taken. 

42. Massachusetts Evaluation Report on E.S.E.A. Title I activities. Bureau of Elementary and 
Secondary Education, State Department of Education, December, 1968, p. 29. 



43. "Cost effective analyses... are designed to measure the extent to which resources allo- 
cated to a specific objective under each of several alternatives actually contribute to 
accomplishing that objective, so that different ways of gaining the objective may be 
compared." See pp. 37>“38, Budwting for National Objectives , a Statement on National 
Policy by the Research and Policy Committee for Economic Development, January, 1966* 

See also the reference to the AST Associates, Inc. , Cost-effectiveness Model in Title 1/ 
Year II , U. S. Office of Education, 1968, p. 117. 
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For a good exposition on the application of program budgeting to the field of educa- 
tional planning, see Hartley, Harry J., E ducational Planning, Programming. Budgeting , 
Englewood Cliffs: Prentice Hall, 1968. 

In listing four imperatives for schools today, the Committee for Economic Devel- 
opment included one on cost-effectiveness: ''School systems must employ continuously 

the results of cost-benefit and cost-effectiveness analyses in order to allocate effec- 
tively the resources available to education and to distinguish among programs of high 
and low priority." (Page 13) In line with this imperative, they urged "Immediate ex- 
ploration by school administrators of the application of program accounting tech- 
niques in order to identify costs in school systems and to take advantage of cost com- 
parisons. The adoption of such techniques by school districts will be advanced 
greatly if assistance and leadership in this area are provided by state departments 
of education and by university schools of business, economics, and education." Innova- 
tion in Education: New Directions for the American School . Committee for Economic 
Development, New York, July, 1968, p. 19. 



The Bank Street College of Education study identifies some 10 to 12 benefits derived 
from having teacher aides on the staff. Most of them are related to a more effective 
distribution of resources and a more efficient utilization of time. Other important 
considerations are concerned with the capacity of the aide, particularly if he lives 
in the same area and/or shares a similar background to the students with whom he works, 
to function as a positive role model for the students and to help Interpret cross-cul- 
tural ly attitudes and behavior both from teacher to pupil and vice versa. Bowman, 

Garda W. , and Klopf, Gordon J., Auxiliary School Personnel: Their Roles, Training, and 
Institutionalization . Bank Street College of Education, October, 1966, pp. 4-5. 

Several states, such as Illinois, Michigan, Colorado, and California have more functional 
definitions of the permissible roles of teacher aides which might be examined as possible 
models. 



Chapter 164 of the Acts of 1965 rules that an instructional or administrative aide (as 
used in Section 38 of Chapter 71, which it amends) "shall be a person who does no actual 
teaching, but acts as an assistant to a teacher." 
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48. Fifty-two percent of the billion dollars provided by Title I was spent on instruction 
during its first year. Part of this went into the creation of 180,000 new part-time 
and full-time professional and sub-professional positions other than teaching. Forty- 
eight of the fifty-four reporting agencies (state) told of turning to salaried sub- 
professionals. The First Year of Tit le I E.S.E.A. 1965, U. S. Office of Education 
(6P0 1967-0-257-037), 1967, p. v and p. 9. 

49. “Assignments for aides varied widely. Most frequently, aides helped prepare materials, 
worked with individual students and small groups, supervised class work and group games, 
corrected papers and performed clerical duties. Many school districts also employed 
aides to work with reading specialists, community workers, nurses, counselors, librari- 

specialized personnel. During 1966-67, there were 83,500 teacher aides 
and 6,100 library aides working in Title I programs." Title I/Year II. U. S. Office of 
Education (GPO 1968-0-312-658), 1968, p. 45. 



50. Teachers expectations are like self-fulfilling prophecies. Children will achieve 

what IS expected of them. This was borne out by a study made in San Francisco by Prof. 
Robert Rosenthal of Harvard University. He told teachers that certain of their pupils 
had a high learning potential, even though some did not. The result was higher teach- 
er expectation and higher pupil achievement at the end of the school year." Title 1/ 
Year II , U. S. Office of Education, 1968, p. 44. ^ 

51. The Bank Street College of Education study on auxiliary personnel found role definition 

and role development for aides to be an Important factor in the success of programs using 
aides. Furthermore, training of aides specific to the tasks their roles will require 
were likewise found to be extremely important. Bowman, Garda W., and Klopf, Gordon J., 
Au^li ary School Pers onnel; Their Roles, Training, and Institutionalization , Bank Street 
college of Education, October, 1966, pp. 6 - 7. 

52. See Ausubel, David P., “A Teaching Strateg>* for Culturally Deprived Pupils: Cognitive 
and Motivational Consideration," School Review , Winter, 1963. 



53. A group of researchers at Arizona State University studied changes in attitudes of 
educators toward disadvantaged children before, during, and after special in-service 
training. Teachers who experienced the Title I training changed favorably toward 
these children while control group teachers maintained unfavorable attitudes. This 
is positive evidence of the worth of training geared to meet special needs. For 
more details, see Title I/Year II , Second Annual Report of Title I, U. S. Office of 
Education, 1968, p. 118. 

54. The Center for the Study of Aesthetics in Education at the University of Massachusetts, 
Amherst, is currently engaged in the development of a curriculum which is based on art 
experience and its relationship to cognitive and affective growth. The Title III 
(PACE) program at Attleboro, Massachusetts, directed by Mr. Donald Brigham, is an out- 
standing example of the way in which involvement in art activities can support motiva- 
tion for learning at high levels. 

55. Title I - E.S.E.A; A Review and a Forward Look - 1969 , Report of the National Advisory 
Council on the Education of Disadvantaged Children, 1969, p. 23. 

56. Some school districts have already begun to do this. Some 15% of the local districts 
increased their 1967-68 regular budgets to support programs initiated by Title I expendi- 
tures. Our survey data indicate around 10% involvement in the local financing of com- 
pensatory education. 
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NOTES AND REFERENCES 



FOR SECTION ENTITLED "MODEL PROGRAM FOR TRAINING COMPENSATORY EDUCATION PERSONNEL" 



For a suimiary statement on differentiated staffing, see Jordan, Daniel C., Task Analv- 
sis and Role Definition . Report from the EPDA task force on differentiated staffing, 

U. S. Office of Education, October, 1967. (ERIC Document Reproduction Service Number 
ED 027252.) 



It is admittedly difficult to determine when given individuals are "caught up," since, 
on the one hand, there may be genetic limitations in given cases which would preclude 
performing at levels consistent with the norm, and, on the other hand, there are un- 
doubtedly many who, through compensatory services, might come to achieve at a level 
comparable to the norm, but still not be achieving at a rate conmensurate with their 
capacities. In the former, cne would be inclined to say they'd caught up if they are 
performing to capacity, while in the latter, one might say they had not caught up 
since they are still "underachieving," even though doing quite well. However, one 

can compare achievement levels of groups and determine whether or not the group has 
"caught up." 

There is also the controversy over whether or not the middle-class values system 
which determines what constitutes the norm, should be imposed on members of any sub- 
culture. Many have expressed grave doubts that that values system, with its emphasis 
on materialism, "success," and technology, is even functional for the nation as a 
whole. This is all the more reason to have the programs focus on the development of 
competent learners, for they will be freer to examine any values system, make respon- 
sible choices, and help the society to change in constructive ways. In this connection, 
see Fantini, Mario, and Weinstein, Gerald, The Disadvantaoed: Challenoe to Education. 

Harper and Row: New York) 1968, p. 156. 



For a more fully developed statement, see Jordan, Daniel C., "New Perspectives on Rele- 
vance in Education," Report on the 1968 Regional TEPS Conference, (National Education 
Association: Washington, D. C. ) 1969, p. 25. 
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60. "It IS in fact the existence of prior capabilities that is slighted or even ignored 
by most of the traditional learning prototypes. And it is these prior capabilities 
that are of crucial importance in drawing distinctions among the varieties needed 
for learning... The initial capabilities of the learner play an important part in 
determining the conditions i^uired for subsequent learning... Each type of learning 
starts from a different 'point* of internal capability, and is likely also to demand 

a different external situation in order to take place effectively." Gagne, Robert M. , 
The Conditions of Learning ; Holt, Rinehart, and Winston, Inc; Hew York, 1965, pp. 21- 
22. See also Melton, A. H. (Ed.) Categories of Human Learning, ?Jew York: Academic 
Press, 1964. 

61. The burden of Hess' thesis is: "In cultural deprivation, the pattern of cooinunica- 

tion that develops between mother and child has an effect upon the child's cognitive 
equipment and communication skills which handicaps him when he logins his sch^l pro- 
gram." Hess, Robert D., "Educability and Rehabilitation: The Future of the Welfare 
Class," Journal of Marriage and the Family , November, 1964, pp. 422-429. 

62. For a good sunmary, see Bourne, Lyle E. Jr., Human Conceptual Behavior , (Boston: Allyn 
and Bacon, Inc.) 1966. 
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"Programs that show signs of imnedlate success often are not, from a long range point 
of view, really successful because the children begin so far behind more fortunate 
students and have so far to catch up. Under the most optimistic assumptions of normal 
progress. Title I children remain behind all through their school career because they 
start^so far behind on the first test administered to them in school. 

"Therefore, a gain that matches the norm is not sufficient. In order to reduce 
the gap between the average scores for Title I schools and those of other schools, the 
Title I group must achieve at a greater rate than the norm." 

Title I/Year II , The Second Annual Report of Title I, U. S. Office of Education, 
1968, page 33. 



DESCRIPTION OF STUDY 



PURPOSE 

The general objective of this study is to assist In the im- 
provement of compensatory education programs in Massachusetts 
through modifications of current programs based on evaluations 
specific enough to permit the formulation of concrete recommenda- 
tions for improvement. For planning purposes, the study was 
originally envisaged as a three-year program with the first year's 
activities being undertaken as a separate unit which could pro- 
vide the basis for the research activities of the subsequent years. 
Obviously, it is not possible to do a thorough study, collecting 
comparative data by using control groups, within one year. Thus, 
the first year's activity was devoted to an inventory of federal, 
state, and local programs, an evaluation of a representative sample 
of programs, and the formulation of recommendations for improving 
evaluation, for modifying the programs themselves, and for new ad- 
ministrative arrangements to facilitate program improvement. 

Since other projects in the State have been set up to evaluate 
programs of special education, such as the education of emotionally 
disturbed children, they did not come within the scope of this study, 



which Is primarily concerned with educational programs dealing 
with deprivations arising primarily from unsatisfactory economic 
and social’ >#H1ons. Other programs which have a direct or 
Indirect ^ the effectiveness of Title I programs (such 

as Model Programs, Foster Grandparents* Headstart, Up- 

.ward Bound, Neighborhood Youth Corps, Family Planning, etc.) were 
not Included as a part of this study, although some attention 
was given to how all these efforts might be better coordinated. 

The Massachusetts Advisory Council on Education has already 
commissioned a study on counseling and guidance, therefore this 
area was also not Included as a major focus of this study. 

PROCEDURES 

Sample Selection : For Intensive study of compensatory educa- 
tion In Massachusetts, a sample was selected from Title I (Ele- 
mentary and Secondary Education Act of 1965) projects since they 
represent the major state-wide effort to Improve the learning op- 
portunities of educationally disadvantaged children and youth. 

The unit of sampling was the project, based on the latest 
available State Department list (1967-68). There were over 460 
funded projects, of which lOX or 46 were selected for our sample. 

A stratified proportional sampling technique was utilized to as- 
sure representativeness of two aspects considered significant: 



whether or not the projects were summer or winter; and, their cen- 
sus classification (SMSA-Standard Metropolitan Statistical Area) 
as modified by the Office of Education and applied to school districts 
according to the State Department of Education usage. The sample was 
randomly drawn within these parameters. Therefore, the lOX sample of 
projects chosen were theoretically representative of the total State- 
wide Title I program administered by the Title I Office of the State 
Department in size and type, and by season of the year — summer or 
winter. 

Once the sample projects were chosen, the superintendents in 
whose districts the projects were operating were informed of the study 
and asked to participate. Two refused, one because project funds 
were so small that the superintendent did not feel it worth his or 
our time, and the other preferred to give no reasons. A third pro- 
ject was dropped from the study because it was not possible to col- 
lect sufficient data on it. This left us with a total of 43 projects. 

Method.^ of Data Collection from the Sample ; Each compensatory 
education project was visited from one to six times, with an average 
number of visits per project being between two and three times. Or- 
dinarily, observers spoke first with the person or persons suggested 
by the superintendent. This was usually a project director or a 
person acting as a project director, many times including the super- 
intendent himself. All projects were observed in operation. Data 
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collectors visited projects 1n teams of two or more whenever pos- 
sible 1n order to Increase the objectivity of observation and re- 
porting. They spoke most frequently with the project director 
(who very often was a principal* supervisor* superintendent, as- 
sistant superintendent* counselor* specialist* or teacher acting 
as director). Equal efforts were made to talk with other members 
of the Title I staff, particularly teachers* specialists* and 
teacher aides. There was less opportunity to speak with non-T1t1e 
I personnel* especially 1n the summer. 

Observers were equipped with a questionnaire and observation 
protocol to guide their collections of data. They were also pro- 
vided with a coding sheet referring to type and source of data so 
that we would have record what kinds of data were being col- 
lected and the source of them. (Please see Appendix III for Infor- 
mation on the questionnaire and observation protocol and Appendix 
V for the code sheet relative to type and source of data.) 

Survey ; To supplement Information obtained on the sample pro- 
jects and to consider all possible compensatory education efforts 
regardless of sources of funding* survey forms were mailed to all 
school district superintendents In April of 1969 according to a 
11st supplied by the State Division of Research and Development. 

Two forms were used for the survey. The first requested gen- 
eral Information on children being served by all compensatory educa- 
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tion projects which were reported on the second form and an estima- 
tion of the total number of school aged educationally disadvantaged 
children and youth In the district. Opinions were also solicited 
as to what kinds of assistance projects would like to have from the 
State Department of Education and from Institutions of higher learn- 
ing. The second form solicited Information on each project consid- 
ered by that district to be compensatory In nature. The definition 
of compensatory education In the covering letter was taken from the 
wmis-Harrlngton Report. (Please see Appendix IV for copies of 
these survey Instruments.) 

Returns on the Initial mailing were disappointing. Two follow- 
up requests were made, Including sending out additional forms. We 
received responses from 173 school districts { 70 % of the total) repre- 
senting 302 projects. Several districts responded after the announced 
cut-off date In September and were not Included In the final analysis. 
Forms were sent to the four diocesan superintendents, but since only 
one responded, these data' were not analyzed. The survey data were 
coded, punched on IBM cards, and analyzed separately from the sample 
data using a series of computer programs. 

NATURE OF THE SAMPLE 

Since we were faced with the problem of selecting a sample of sum- 
mer and winter projects, many of which had not yet been approved or 






even proposed* we selected our sample from a list of previous year's 
projects on the assumption that most of them would probably be re- 
peated. This procedure necessitated making substitutions In the 
cases of projects which were modified or dropped. Taking Into con- 
sideration the substitutions that were necessary* the final sample 
Included 18 school year (winter) projects and 25 summer ones. 

The grade levels of the original sample were similar to those 
of the total projects In the previous year.^ The majority of the 
projects served children In grades 1 through 6* Including various 
combinations of grades within that span. There were a few ungraded 
projects* pre-school projects* senior high projects* and several In- 
cluding junior high grades. 

Describing the content of the actual projects observed Is a dif- 
ficult task. School districts are free to title projects any way they 
wish and projects are often multl-dli/ienslonal. Various ways of titling 
projects Include: by time of year (Title I Summer); by Instructional 
method (Taped Teaching); by grade level (Pre-School); by type of child 
served (Aid to Underachievers); by staff utilized (Teacher Aide); or* 
by a catchy acronym (R.S.P.) or a nickname (Operation Bootstrap). 
Clearly* titles are of little use In describing the project. Also* 
almost every project Includes more than one activity* especially In 
the summer. 



^ Toward an Equal Chance— Title I. Massachusetts Department of 
Education* Publication No. 268. 
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Generally speaking, our sample seemed similar to the totality of 
projects for the State. There Is a heavy emphasis on reading. More 
than 80% of the sample projects Included a reading activity. This was 
sometimes part of a more comprehensive language arts approach or It 
was sometimes geared to special problems such as perceptually handi- 
capped or non-English speaking students. Teacher aides and tutorial 
components were usually associated with projects with a heavy commit- 
ment to reading. Several multiple-activity projects Included math and 
enrichment activities, while fewer Included physical education and 
science. Two were specifically of a counseling or diagnostic nature. 
Two summer projects were conducted on a day-camp basis and Included 
academic and non-academic activity. One of the projects was solely 
work-study, while another Included vocational education. One project 
served a special education population. 

The kind of mix reflected In our sample constitutes one of the dif- 
ficulties In administering Title I projects. Each one Is based on the 
perceived needs of local school districts and their own designs to 
meet those needs. Further details on the nature of the projects can 
be found under the sub-section on Needs and Objectives In the section 
on Findings and Recommendations. The list of projects In the sample may 
be found In Appendix II. 
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ANALYSIS OF THE DATA AND RECOMMENDATIONS 

Findings and recomnendatlons are organized In a form con- 
gruent with the structure of the questionnaire and observation 
protocol used for the evaluation of the projects In the sample. 
The protocol was designed to meet the needs and purposes of 
the study while at the same time reflecting In content a rea- 
sonably comprehensive view of the research literature on com- 
pensatory education. (A full outline and commentary on the 
questionnaire and observation protocol mey be found In Appendix 
III, page 275.) 

The analyses are thus organized In three parts: Part I 
concerns planning and evaluation procedures; Part II deals with 
variables which research has demonstrated to be critical to the 
success of compensatory education programs. Part III summarizes 
the analysis of the survey data. 

Findings and recommendations falling within a given category 
are discussed In each case (Gothic type style) after a presenta- 
tion of excerpts from the questionnaire and observation protocol 
{italic type style) relevant to that category. These categories 
may therefore serve as a table of contents for the findings and 
recommendations pertinent to them: 
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PART I: PROJECT PLANNING. EVALUATION. AND MODIFICATION 

A. Planning Procedures 

B. Formulation of Project Objectives 

C. Selection of Project Participants 

D. Project Evaluation 

E. Program Modification 

PART II: PROJECT STAFFING. TRAINING. AND CURRICULUM 

F. Staff Characteristics* Selection* and Recruitment 

G. Pre-service and In-service Training 

H. Learning How to Learn— Developing Effective Learners 

I. Motivational Aspects of the Program 

J. Parental* Home* and Community Involvement 

PART III: SUMMARY OF FINDINGS FROM ANALYSIS OF SURVEY DATA 

Data from School Districts 
Data on Projects Within Districts 
Cross Tabulations 






PART I : PROJECT PLANNING, EVALUATION, AND MODIFICATION 

A. PLANNING PROCEDURES 

i. WHO WH'J IHVOLVBD IN THE PLANNING PROCESS? 

Since evaluation is based on a determination of 
how well efforts are achieving objectives , judgments 
about the quality of a project's evaluation activi- 
ties will depend, at least in part, on what objectives 
were adopted and how they were formulated as part of 
the planning process. Thus, information was gathered 
on all aspects of project planning. 

We were interested in finding out how extensive 
were the personnel resources used in planning! where 
tile executive power in making planning decisions was 
located! to what extent universities and colleges were 
involved in planning! whethm or not Title I students 
and Title I parents had a say in the planning of pro- 
jects which will a//ect them! and, to what extent the 
school assumed leadership in cooperative planning with 
other agencies which might be pertinent to the achieve- 
ment of project objectives, such as Community Action 
Agencies, welfare agencies, Public Health Service agen- 
cies, etc. 



In examining who was Involved In the planning process, we 
found that administrative personnel were largely responsible for 
the planning of this year's Title I projects: superintendents. 



principal?;^ superintendents' staffs, project directors, 
and supervisors accounted for over half of the categories 
of persons mentioned as being Involved In planning (55 
out of 96 people In 43 projects). Teachers accounted for 
less than 1/5 of the planning staff positions represented 
(18 out of 96 people Involved In the planning of 43 pro* 

Jects). Counseling and guidance positions were ranked next 
In frequency (10 out of 96 In 43 projects). No other group- 
ing was mentioned more than twice. Personnel mentioned 
once or twice Included remedial reading specialists, psy- 
chologists, CAP directors, medical personnel, social work- 
ers, parochial school or church personnel, and students. 

Parents were never mentioned In response to this question. 
Community Action Agency and parochial school officials were 
mentioned only twice each, even though their Involvement Is 
supposedly Imperative by law. 

It Is Important to note that these responses reflect 
the actual categories of persons mentioned by those running 
the Title I projects as planners. We may therefore suppose 
that these are the decision makers, and though others may 
have been Included In formal lists, etc., their Influence was 
not recognized or decisive. 

As for university planning and participation, we found 
that 35 out of 43 projects (81X) did not receive any university 
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or college support In planning or Implementing their projects. 

Of those who didt six specific kinds of assistance were used 
by seven projects. They are as follows: 

1. Consultants In testing and diagnosis 

2. Providing workshops for teachers as pre- 
service training 

3. Research (graduate student) 

4. Consultant for evaluation 

5. Resource for planning Ideas 

6. In-service training 

Only one of the 35 projects responding “yes" to the ques- 
tion of university participation In planning used university 
personnel for Input to the total project, Including Involve- 
ment In planning, materials selection, training of personnel, 
and evaluation. It should be noted here that many public school 
people felt that university personnel were often not qualified 
to provide the kind of expertise needed for much of the planning. 
The fact that there Is such a shortage of well -trained person- 
nel In compensatory education Is the most striking evidence that 
universities are not meeting compensatory education manpower 
needs, possibly because they, too, lack personnel trained In 
this area. In any case, university people who are not Involved 
on a day to day basis with the educational problems facing dis- 
advantaged youth and those teaching them are not very likely to 
be effective In helping local school districts plan and Implement 
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programs for the disadvantaged. The converse is probably 
more likely to be the case: that public school personnel 
will be able to help universities set up programs of pre- 
service training for students preparing to specialize in 
some aspect of compensatory education. Doing something 
about this manpower shortage is largely a matter of es- 
tablishing more effective teamwork between universities 
and the public school system. 

Only 9 districts were identified as having taken lead- 
ership in cooperative planning with other agencies. Even 
this figure may be Inflated because it appears that schools 
often tell other groups of their plans and seek their ap- 
proval without involving them in cooperative planning ef- 
forts. 

The only organizations mentioned more than once as be- 
ing Involved cooperatively in planning were Community Action 
Agenci es whi ch appeared as responses from 3 out of 35 of the 
projects of the sample from which data were available; Con- 
sidering the overlapping target populations of Title I and 
Community Action Programs and the fact that Title I legisla- 
tion gives recognition to CAP agencies, this finding is dis- 
appointing. 

Active participation of members of community agencies and 
organizations helps to create a stake in the program's success 



^ . 




159 



and often results in being able to mobilize volunteer help 
in getting the program underway or assistance in carrying 
out special activities which need additional help during 
the course of the project. Lack of awareness of this value 
of involving members of other agencies can result in over- 
sights that may reduce the effectiveness of the program. 

For instance, one reading program had hoped to use the 
library as a part of the project's activity. However, 
this aspect of the program had to be abandoned because of 
a scheduling conflict with the library. On checking, it 
was found that the town librarian was not included in the 
planning. 

Only 3 projects out of 36 from which data were avail- 
able actively included students in the planning of their 
projects in the following ways: 

T-group type sessions within the project 
(11th & 12th graders); 

Secondary level students helped to plan the 
work-study aspect of a project; and. 

Director discussed felt needs with target 
area students. 

Only active participation In actual planning was recorded as 
constituting a positive response. A student having freedom to 
go or not to go to a planned activity was not considered as 
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3n Gxdinple of actlvo participation. SGVGral schools mentioned 
using student evaluation in replanning. 

It is recognized that in the case of very young ele- 
mentary school children, it might not be suitable or feasible 
to have students participate in planning. However, given the 
trends in changing attitudes and the increasing emphasis on 
democratic processes in education, it seems important that stu- 
dents be given a stake in the enterprise. Involvement would 
extend from yearly planning to periodic evaluation, and include 
meeting to assist in planning daily activities. The absence 
of student involvement was especially surprising in summer pro- 
grams where attendance was voluntary. 

2. HOU WERE THE STUDENT NEEDS ON WHICH THE PROJECT WAS 
BASED DETERMINED? 

Of particular concern here was information on the 
actual needs f how they firere identified^ and whether or 
not and how priorities amony the needs iirere determined. 

Needs as determined by planners of projects in the sample 
seemed to show little change from those that were typical of 
Title I when it first started. There is little evidence that 
there is any systematic review of needs. Project planners' and 
staff members' opinions seemed to be the determining factor re- 
garding the identification of needs (over 1/3 of all responses 
from 38 projects from which data were available). 






Sometimes needs were obvious as In the case of students 
not being able to speak English. Otherwise they were based on 
opinions of staff members, or, In some cases on assessment of 
specialists, test scorers, being below grade level In a given 
subject matter, or having failed a previous grade. As can be 
seen from the above, there was a tendency to state symptoms 
of conditions which probably represented unfulfilled needs, 
rather than needs themselves (I.e., falling a previous grade 
Is not a need, It Is symptomatic of a variety of unmet needs, 
some or many of which may be more pertinent to the school sys- 
tem than the chllo). In short, program planners adopted no 
systematic means of Identifying needs. 

As far as determining priorities was concerned, only one 
need was listed by 10 projects out of 33 for which data were 
available; therefore, priorities were of no concern to these 
projects. In 11 projects, priorities were determined by an 
administrative decision with no basis given. In 4 projects 
the priority decisions were considered Intuitive, i.e., determi- 
nation was based on the feelings and general knowledge of the 
staff. Other responses occurring twice included teachers' ob- 
servations, testing within a designated area, and convenience 
or practicality. 

We collected information on the three needs which project 
personnel felt to be most outstanding in rank order. In 
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both summer and winter projects reading improvement was men- 
tioned as the highest ranking need . It also received the 
highest count across all three needs, i.e., it was the most 
frequently mentioned need when categories of needs were 
tabulated without regard to rankJ 

The second most frequently mentioned need was improve- 
ment of self-image . While it was not ranked first place as 
often as reading improveient, it appeared almost as fre- 
quently when categories were totalled without regard to rank. 

The next most frequently mentioned needs, occurring only 
half as often as the above two needs, in rank order were: 

Improvement of attitude toward school 
Cultural enrichment and broadened experience 
Language skills 

All of the above have obvious connections with the two most 
frequently mentioned needs, improvement of reading and self- 
image. 

Need for enrichment and improvement of attitude toward 
school were more frequently listed as needs in summer projects 
than in winter projects. 

^ Most states ranked improvement in reading as the major need. 

See Section II, "How the States Identified and Met Children's Needs," 
P* 40, The States Report; The First Year of Title I . HEW, USOE, 

1967, available from U. S. Government Printing Office. 







No other need was mentioned more than three times. 
Others listed were: 

Individual help and attention 

Challenging curriculum 

Remediation of perceptual handicaps 

Learning how to speak English 

Decreasing the drop-out rate 

Working with mental retardation 

Improvement of performance on standardized tests 

Math skills improvement 

Social adjustment 

Improved racial balance 

Health education 

(See Appendix VI, page 306, for tabulation.) 

There are many more needs than Title I can or is de- 
signed to meet in any given locality. There are also alter- 
nate methods of meeting these needs. It is apparent that 
need priorities should be determined in a more systematic 
way. Even though at times an answer thus derived would be 
the same as an intuitive judgment, the process of determining 
needs in a systematic way would serve to clarify the project 
purpose and present a clear beginning or re-cycling point in 
the total planning-evaluation process. 



3. HOW MUCH TIME WAS THERE FOR PLANNING? 

Exploration of this question included gather- 
ing data on the amount of time between the planning 
and the start of the project. The time factor has 
obvious implications for program quality. 




There was such a wide variety of responses to this in- 
quiry that no discernible pattern emerged. A few projects 
(3) had only one or two weeks between planning and the start 
of the project. One had been rejected by the State Depart- 
ment and needed to replan. Another was waiting for funding 
notice. On the average, there was between one and two months 
of time lapsing between planning and the start of the pro- 
ject. One project indicated that planning was ongoing through- 
out the year. Only 4 had planned 4 or more months before the 
start of the project. Several projects mentioned hand-carrying 
proposals to Boston because of the time pressure and the de- 
sire to avoid crippling delays. (See Appendix VI, page 307, 
for tabulation.) 

Since school districts cannot hire personnel or order 
materials until the money for the project is actually allocated, 
and since there needs to be considerable lead time in order to 
do this properly, some provision needs to be made to improve 
the pacing of planning, submission of proposal, approval of pro- 
posal, and start of the program. Basically, this is a problem 
stemming from Congressional appropriation schedules which are 
not congruent with any reasonable planning schedule for school 
systems. 

Less than one-quarter of the winter projects mentioned re- 
planning at the end of the project for the next year. Only one 
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summer project Indicated that they replanned right after the 
summer experience. It would seem that given four years of 
experience with Title I» local school districts could do a 
major portion of the planning without having to determine 
absolute dollar amounts needed and other administrative de- 
tails. Needs, objectives, methodology, evaluation, and 
other aspects of planning could be started much earlier than 
currently appears to be the practice. 

4 . IS THIS YEAR'S PROGRAM A REPEAT OF LAST YEAR'S PROGRAM? 

This question was extended into a consideration 
of the rationale for repeating or not repeating a pro- 
ject, ascertaining what kinds of revisions had been 
made and on whe.t basis, and whether or not the pre- 
vious fiscal gear's project evaluation was used in mak- 
ing a decision about whether or not to repeat the pro- 
ject or to make revisions. 

Most of both the summer and winter projects were repetitions 
of last year's projects, excluding minor revisions. Only five 
projects out of our sample of 43 had new programs this year. 

On Inquiring Into the rationale behind repeating a pro- 
ject, we found that the major reason for the decision to repeat 
or not to repeat was based on people's Intuitive feeling that It 
was a good program. The usual response was "we felt It to be a 
successful program." Continued need was mentioned three times as 
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a rationale for repeating a project. No other answer was 
mentioned more than twice. These Included: 

Not enough progress to drop It yet 
Standardized testing showed gains 
It permits teachers to continue their experience 
Favorable reactions from students, parents, and 
teachers 

Of those who decided not to repeat, the reasons were: 

The project was not successful 
The project was used to "seed” new projects within 
the district and these have now been Initiated 
Informal reconmendat1o))s from staff members to d1s~ 
continue 

there seems to be considerable habitual repetition of some- 
thing once It Is started based upon purely subjective notions. 

A repeated project should require as much or more Justification 
than a new one and should be backed up by a positive evaluation. 

Out of 33 projects for which data were available, nine had 
made no revisions. Twice as many winter projects as summer pro- 
jects made no revisions. It appears that winter projects tend 
to be less flexible than summer projects, probably for the ob- 
vious reason that In the summer the regular school Is not going 
on and flexibility Is more easily achieved. 

Changes In six of the projects concerned personnel, either 
In changing a specific person or changing of position. Five 
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Sumner projects and one winter project became more diversified 
In services or program components. No other change was cited 
more than twice and Included: 

Service to more grade levels 
Fewer subjects Included 

More staff Involvement In decision making relevant 
to the project 

Utilization of a different selection process 

Change In the curriculum 

Addition of teacher aides 

Serving of fewer grade levels 

Change In whether or not testing was used 

(See Appendix VI, page 308, for data summary.) 

Only six of the 33 projects Indicated that they had made 
some use of the previous fiscal year's evaluation In Introduc- 
ing modification. (See Section E, Program Modification, page 
for additional Information.) 

5. miAT PLANS WERE MADE FOR IN-SERVICE TRAINING? 

In some cases in-service training is regarded as 
a project activity which therefore needs some careful 
planning. We were interested in finding out how the 
in-service training as a project activity was planned, 
who was involved in the planning, and how the in-ser- 
vice training related tc project objectives. (See 
Section B for information on project objecti.ves.) 

Twenty-five out of 40 projects for which data were avail- 
able had no planned pre- or In-service training. Planned actlv- 

168 







Ity was mentioned by the remaining 15 projects with the In- 
dication that It was planned by the director* In some cases 
In collaboration with a specialist or consultant. 

Generally speaking, plans for training were of two 
types: (1) training for project staff generally, or (2) 
training related to specific problems encountered within the 
project. 

Five projects mentioned that the planning for pre- and 
In-service training took place through weekly staff meetings. 
By and large these were Informal sessions, not part of the 
formal planning process. Since this Is the typical school 
practice In any program, there Is probably more of this than 
was mentioned. Other projects mentioned planning for orient- 
ing parents on what the pr*oject aimed to achieve and how par- 
ents could be supportive; plans for training personnel on 
testing; and training by a book publisher on use of support- 
ing materials. (See Section 6, Part II, page 217, for discus- 
sion on the actual pire-service and In-service training aspects 
of projects In the sample.) 

In any case. It appears that the planning for both pre- 
and In-service training of staff on the whole was not a very 
prominent part of the planning process and that where It did 
occur. It often did not have a focus congruent with specific 
project objectives. 
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6. DID THE PROJECT PLANNERS DETERMINE THE EVALUATION PRO- 
CEDURES? 

Since the evaluation aspects of many educational 
projects are added after the planning has been carried 
out, and in some cases even after the program has been 
implemented, we were interested in the vital question 
of the relationship between planning and evaluation 
and to determine the degree to which evaluation was 
present in the minds of those who actually planned the 
project. 

In reply to this question we found that In 29 projects out 
of the 33 from which data were available, project planners were 
also responsible for the planning of the evaluation procedures. 
This turned out to be the case in spite of the fact that most 
planning groups did not include members who had expertise in 
developing sound evaluation procedures. This finding has clear 
Implications for training personnel in evaluation. Administra- 
tors who plan the evaluation of their projects need specific 
training in evaluation sufficient enough to provide this expertise 
or develop enough knowledge about it to recognize the need for 
hiring well-trained evaluation personnel to assist in the planning. 
(See Recommendation in Section D, page 186.) 



7. WERE THERE ANY THEORETICAL FOUNDATIONS TO THE PLANNING? 

Since so many programs cone into being with no re- 
gard to research findings or useful theory, we were in- 
terested in ascertaining the extent to which Title I 
program planners adopted any predetermined theoretical 
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basis for making planning decisions. For instance, 
special attention was given to whether or not the 
planners decided to have a structured or unstruc- 
tured program based on some theoretical orienta- 
tion to this question. 

Over half of the projects (24 out of the 37 projects for 
which data were available) cited no theoretical basis for the 
planning of the project. Twenty-nine projects out of 42 con- 
sidered their project to be structured; six considered their 
projects unstructured; while six felt theirs combined both. 

One project mentioned the transition during the project from 
structured to unstructured approaches. Structure here was in- 
tended to refer to the student's situation. It was often noted 
that the project was fairly unstructured for teachers, especi- 
ally in the summer, while still being fairly structured for 
students. Smaller groups gave the teachers more freedom to 
prescribe different activities according to students' needs. 
Observers commented that children sometimes had more freedom in 
Title I classes than in regular classrooms but still have little 
choice or decision in their activities. Even summer programs 
generally followed relatively precise schedules. Generally speak- 
ing, projects were either structured or unstructured depending 
upon the experience and preferences of project personnel rather 
than upon any consciously accepted theoretical basis. (See 
Appendix VI, page 309, for data summary.) 
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RECOMMENDATIONS 

There are several partners which must join hands in provid- 
ing effective compensatory educational services for disadvan- 
taged youngsters: the youngsters themselves and their parents; 

school personnel; and, representatives of the community and its 
agencies and institutions. The more involved all members of the 
partnership are in the conception of programs, the better the 
programs are likely to be, not only because there will be many 
useful perspectives on needs and objectives forthcoming from a 
team effort, but also because participation in the creation of 
something tends to inspire commitment and support for it.^ We 
therefore recommend: 

(1) THAT LOCAL SCHOOL DISTRICTS BE ENCOURAGED THROUGH WHAT- 
EVER APPROPRIATE MEANS TO DEVELOP MORE BALANCED PLANNING 
COMMITTEES WHICH WILL INCLUDE TEACHERS, SPECIALISTS, 
PARENTS, COMMUNITY REPRESENTATIVES, STUDENTS, AND EVALU- 
ATORS (BOTH LOCAL AND FROM THE STATE DEPARTMENT). 



"Such programs, in our experience, have usually been planned 
by teachers or curriculum expe»*ts who are separated from district 
evaluation personnel both organizationally and philosophically." 

For fully developed statement, see: Hawkridge, D.G., & Chalupsky, A., 

"Evaluating Educational Programs," The Urban Review , vol. 3, 
no. 4, February, 1969, p. 8. 
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However, such team effort takes more time and, as our data 
show, this is often not available because of unrealistic deadlines 
for submitting proposals and lack of release time from other re- 
sponsibilities on the part of school personnel We recommend: 

(2) THAT THE STATE DEPARTMENT OF EDUCATION, TITLE I OFFICE, 
STUDY THE PACING OF EVENTS STARTING FROM THE INITIAL 
PLANNING TO THE BEGINNING OF THE PROJECT AND THAT ON THE 
BASIS OF THAT STUDY NEW DEADLINES BE ESTABLISHED FOR (a) 
SUBMISSION OF PROPOSALS OR PROSPECTUSES AND (b) REVIEW 
AND APPROVAL/DISAPPROVAL OF PROPOSALS SO THAT ADEQUATE 
LEAD-TIME CAN BE MADE AVAILABLE FOR: 

1 . PROGRAM PLANNING INVOLVING COMMUNITY MEM- 
BERS AND PARENTS 

2. PERSONNEL SELECTION AND RECRUITMENT 

3. PRE-SERVICE TRAINING, AND 

4. ORDERING OF SUPPLIES AND EQUIPMENT AND AR- 
RANGING FIELD TRIPS. 



"The reason for the bits-and-pieces approach to the development 
and organization of Title I programs is that there has usually been in- 
sufficient planning in advance. This failure in planning is partly the 
result of knowledge of how to plan and partly the lack of time to plan." 

Dyer, Henry S. , "Evaluating Educational Programs," The Urban Review, 
vol. 3, no. 4, February, 1969, p. 10. 

2 

See section entitled "Setting up a planning committee," A Survey 
of Title I Reading Projects , p. 40, published by U.S.O.E., Division of 
Compensatory Education, November, 1967. 
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IF A GIVEN SCHOOL SYSTEM WANTS TO RADICALLY CHANGE 
ITS PROGRAM, WE SUGGEST THAT THE TITLE I OFFICE CON- 
SIDER INITIATING A PRE-PROPOSAL REVIEW TO AVOID 
LAST MINUTE REJECTION. 



(See Recommendation 27, page 215, concerning release time.) 

Many of the deadlines are somewhat inflexible and badly 
timed due to Congressional appropriation schedules. This has 
been documented by any number of studies and represents a 
'serious obstacle to effective program planning and adminj^ra- 
tion.l We therefore recommend: 



(3) THAT THE STATE DEPARTMENT OF EDUCAT^If DETERMINE THE 
OPTIMUM TIME(S) FOR RECEIVING MDNIK FROM THE U. S. 
OFFICE OF EDUCATION AND PR^SSFOR A REVISION IN 
U.S.O.E. POLICY THROUJFKfVERY AVAILABLE CHANNEL 
USING EVERY AVAILABi^^ MEANS. 



When pre- service 



1 -service training is not carefully 



planned, it tendsyto be taken over by a concern for administra- 



^ Although poor timing was particularly bad during the first 
year of/Title I, the problem still continues. See section "IV. 2 
Time/Of Operation and Duration," The Impact of Title I; Assessnrent 
P rogram for New England , New England Educational Data Syste^^s, uec. 
T967, p. 59 
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tiye^etails or specific problems as perceived by the staff. 
If training is related only to problems as they arise, very 
often important aspects of training are neglected and if it 
is too informal, it tends not to be conducive to a disci- 
plined inquiry and acquisition of important knowledge. With' 
the wealth of knowledge accumulating in the area of compen- 
satory education, all teachers should be exposed to it. Al- 
though independent study should not be discouraged, there 
are advantages to a well planned training program character- 
ized by extensive interaction among staff members. It helps 
to achieve a cohesiveness and integrity of the project when 
it is operational, and particularly so when staff members are 
directly involved in the planning of their own pre-service 
and in-service training. For these reasons we recommend: 

(4) THAT PRE-SERVICE AND IN-SERVICE TRAINING BE CON- 
SIDERED AN INTEGRAL PART OF EACH PROJECT WHICH RE- 
QUIRES CAREFUL PLANNING CONSISTENT WITH THE CURRICU- 
LUM FOR STUDENTS, THE OBJECTIVES OF THE PROJECT, 

AND THE TRAINING NEEDS OF THE STAFF. 

Good programs depend on good planning and good planning 
involves identification of needs and setting priorities. Our 
data indicate that more attention should be given to this as- 
pect of planning. Our recommendation is; 
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(5) THAT THE STATE DEPARTMENT PROVIDE SOME SPECIFIC 
GUIDELINES AND SUGGESTIONS FOR PROJECTS TO FOLLOW 
IN IDENTIFYING NEEDS AND SETTING UP THEIR OWN PRI- 
ORITIES. 

Deciding how specific needs are to be met constitutes one 
of the greatest challenges in planning. Without the assistance 
of theories concerning learning and the problems faced by the 
disadvantaged— theories which research has begun to demonstrate 
as useful and productive, programs can be planned on a trial 
and error basis only; and, if evaluation is inadequate, errors 
can never be identified. Project data show a real lack of the 
use of theory in planning. (Please see Part II, Sections H and 
I, for full discussion on the issue.) We therefore recommend: 

(6) THAT TITLE I PROGRAM PLANNERS BE ENCOURAGED TO IDENTI- 
FY AND DOCUMENT A THEORETICAL BASIS FOR THE PROJECT 
CONTENT AND METHOD AS PART OF THEIR PROPOSALS. 

In many cases, planning took little effort because the pro- 
ject was being repeated. Further, our data indicate that usu- 
ally there was no justification, based on the project's demon- 
strated efficacy, for repeating it. Under this arrangement, in- 
effective, useless, or even harmful elements of projects may be 
repeated. Even if a given activity is just useless in itself, 
it is still harmful because it takes the child away from the 
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regular classroom where he would be learning something.^ 

We therefore recommend: 

(7) THAT THE STATE DEPARTMENT TITLE I OFFICE REQUIRE 
DOCUMENTATION FROM SOUND EVALUATION PROCEDURES 
THAT THE PREVIOUS YEAR'S PROJECT HAS BEEN SUCCESS- 
FUL OR SHOWN SUBSTANTIAL PROGRESS BEFORE APPROVAL 
FOR REPETITION OF THE PROJECT IS GRANTED.^ 



"Unfortunately, the failure to consider research and evalu- 
ation as an integral component of the educational system has re- 
sulted in a sequence of activities which virtually guarantees the 
equivocal findings characteristic of Title I and other compensa- 
tory educational programs... While proposals to obtain funding 
may have reflected contributions from trained evaluators, these 
good intentions have been forgotten often or severely compromised 
once the funds are obtained and the time comes for detailed pro- 
gram planning. As a consequence, non-measurable objectives went 
unchallenged while evaluators contented themselves with easily ob- 
tainable data of questionable relevance." See "Evaluating Educa- 
tional Programs," by Hawkridge and Chalupsky, in The Urban Review, 
vol. 3, no. 4, February, 1969, p. 8. 

2 

State Department Title I Office recently held a number of 
conferences at which time they announced to Title I project direc- 
tors and planners that they will require this kind of documenta- 
tion for proposals being submitted beginning summer, 1970. There- 
fore, this recommendation is in the process of being implemented 
now. 





B. FORMULATION OF PROJECT OBJECTIVES 



8. HAVE PROJECT OBJECTIVES BEEN DEFINED IN BEHAVIORAL 
TERMS? 

Since one of the perennial difficulties in 
evaluating programs is related to the fact that ob- 
jectives are not stated in any measurable form, we 
were interested in finding out to what extent pro- 
ject planners were able to form their objectives in 
precise enough terms to permit adequate evaluation. 

We were also interested in ascertaining whether or 
not success criteria were established for individual 
students and for the project as a whole and whether 
or not degrees of accomplishment or outcomes were 
specified for each of the objectives (so that pro- 
ject administrators might know the extent to which 
they were approximating their goals) . 

In general, project objectives were not defined in behavior 
al terms. Occasionally a specific behavior would be mentioned 
and a degree of accomplishment would be vaguely noted. ^ In one 



^ This finding has been found in reports on compensatory educa- 
tion programs throughout the country. For example, Wilkerson states: 
"I have been involved in the evaluation of Title I programs in New 
York City, and am impressed with the vague and imprecise manner in 
which the project objectives are defined. We read, for example, that 
a project's purpose is to provide tutorial service for children on 
the secondary school level... What I am suggesting is that many of 
our programs tend to define their objectives in rather general, some- 
times procedural ways, rather than in terms of the behaviors they hope 
to achieve so far as the learners are concerned. If we could get into 
the practice of defining always what our programs seek to accomplish 




case, where objectives were well-stated in behavioral terms, 
it turned out that the teachers did not understand behavioral 
objectives and had not used them in the actual classroom pro- 
gram as a means of understanding how well they were achieving 
their goals. Thirty-seven of the projects out of the 40 re- 
porting indicated that they did not state the objectives of 
their project in behavioral terms. Even in the case of the 3 
who felt that they had specified objectives in behavioral terms, 
they frequently did not meet the criteria which we established 
as a means of judging whether or not objectives were in fact 
defined in behavioral terms (namely, that specific behaviors 
were noted, under what conditions or circumstances these be- 
haviors were to be expected, and to what degree).^ Only two of 
the projects specified degrees of accomplishment for their ob- 
jectives. Some projects indicated that students should get to 



in terms of the behaviors of learners, not only would this help 
guide us to appropriate instructional methods and materials, it 
would also give us criteria by which to measure our success." 

Wilkerson, Doxey, "We Must Define Behavioral Goals," Report of 
Conferences on Improving the Education of Disadvantaged Children , 

U. S. Office of Education, 1969, p. 27. 

^ Johnson, Ray A., "Writing Performance Objectives," A Guide 
to Evaluation; Massachusetts Information Feedback System for Voca- 
tional Education, Massachusetts Department of Education, September, 
1969. 
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grade level on a specific or on a general classroom perfor- 
mance basis I but the objectives did not show how the teachers 
would be able to tell whether or not it had been done. 

Observers reported a feeling of reluctance on the part 
of project staff members to accept the idea of pre-determining 
what to expect from the children. In some cases it seemed as 
if project staff members felt uncomfortable about the possibil- 
ity of failing to achieve objectives and therefore the thought 
of setting specific objectives was disturbing. 

Five summer projects and nine winter projects reported 
some kind of success criteria for students. Generally speaking} 
these criteria were vague and centered on the child reaching 
grade level. In only one or two cases did the criteria seem 
to be written down anywhere, and in most cases they were the 
director's personal "ideas" about a successful student rather 
than any well-defined concept of achievement which had been com- 
municated to the staff. Fewer projects (2 summer and 4 winter) 
had specified success criteria for the project as a whole and 
eVen these tended to be somewhat vague. In general, projects 
were not seen as entities for which success measures might be 
developed that would enable the total program to be evaluated as 
a program differentiated from achievements of individual children. 

9 . WHAT RELATIONSHIP DID PROJECT OBJECTIVES HAVE TO 
ASSESSED NEEDS? 
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Obviously, if a program is going to fulfill 
actual needs, project objectives should be based 
upon a careful assessment of needs. We were inter- 
ested in determining how well orgemized the planning 
procedure was and the extent to which objectives 
were relevant because they bore a direct relation- 
ship to assessed needs. We were also interested to 
note whether or not project planners considered when 
they formulated objectives the fact that most Title 
I pupils are behind when they enter the project and 
that they have to achieve at a rate above the norm 
if they are to catch up, 

Reading or language and verbal skill development objec- 
tives were usually mentioned among those objectives considered 
to be among the top three in rank; objectives pertaining to 
the improvement of self-image ranked second place in impor- 
tance, while change in attitude toward school ranked in third 
place. ^ Generally speaking, project objectives were congruent 
with identified needs. Frequently projects had listed more 



Our findings closely parallel those reported in the State 
Department report on Title I in 1968. 

Massachusetts Department of Education, Bureau of Elementary and 
Secondary Education, Massachusetts Evaluation Report on E.S.E.A . 
Title I Activities , December, 1968. 

They are also consistent with findings of a national survey 
taken during the first year of Title I in which 755^ of the projects 
were found to be concerned with reading and language skills. 

Report of the National Advisory Council on the Education of 
Disadvantaged Children , U. S. Office of Education. GPO 911-478. 
March, 1966. 



objectives than needs. The Informally stated objectives 
frequently did not correlate with the first mentioned ob- 
jectives. For Instance, observers frequently heard state- 
ments such as "yes, we teach reading, but what we're real- 
ly trying to do is give these kids a better self-image and 
make them like school more." 

Of 25 projects from which data were available, five 
indicated their awareness of the need for disadvantaged 
children to learn at a rate above the norm. In* four of 
these projects, this was stated as one of the main objec- 
tives. In two projects, it was reported that only a normal 
gain could be expected and therefore nothing beyond this 
could be adopted as an objective. 



10. WAS THERE AGREEMENT AND UNDERSTANDING ON PROJECT 
OBJECTIVES AMONG STAFF MEMBERS? 

One of the common causes of organizational 
ineffectiveness is the fact that many people in 
the organization have no conscious notion of the 
objectives of the organization of which they are 
a part. Observers interviewed to find out the ex 
tent to which project staff understood the pro- 
ject’s objectives and agreed with them and the de 
gree to which staff members maintained a common 
implementational commitment to the priority of 
objectives. 







Eleven winter projects and ten summer projects indi- 
cated that the staff was in basic agreement with the objec- 
tives of the project and that they were understood. Ob- 
servers noted, however, that people generally agreed that 
reading, math, etc., must be the main focus of the project 
if it were a reading-math project, but that they had no 
concept of the overall scope of objectives. Most teachers 
reported that they had never seen objectives written down 
or heard them discussed at length during meetings. For in- 
stance, directors frequently reported to observers how im- 
portant the improvement of self-image was, while the teachers 
would be talking primarily about reading and give no indi- 
cation that improvement of self-image was actually pursued 
as an important part of the curriculum. (See Appendix VI, 
page 310, for data summary.) 

RECOMMENDATION 

In education everywhere there is evidence of a distinction 
between what educators say they propose to do and what they find 
themselves doing. In compensatory education this is particularly 
true (largely because we have a better notion of what we want to 
achieve than how to achieve it). This is not a matter of willful 
deception, but a problem of inadequate attention to the evaluation 
process as it relates to objectives and priorities within objectives. 




stake and Denny have expressed It succinctly: 

Not only must the evaluator report the goals but he 
must indicate the relative importance of the goals. 

Goals are not equally desirable; some have priori- 
ty over others. Different educators will set dif- 
ferent priorities, and the same educator will change 
his priorities over time. Priorities are complex 
and elusive, but the evaluation responsibility in- 
cludes the Job of representing them. New conceptu- 
alizations and new scaling techniques are needed to 
take a first step toward discharging this responsi- 
bility. 

The great weakness in our present representa- 
tion of goals is that it does not guide the alloca- 
tion of resources. Goals compete for our support, 
for our efforts. Relying on some explicit or im- 
plicit priority system, those who administer educa- 
tion decide among alternative investments, operation- 
al expenditures, and insurances. Evaluation re- 
quires an acknowledgement of priorities. ^ 

Not only do the priorities need to be clear, but the ob- 
jectives need to be explicit and operational. Otherwise, they 
cannot be conmunicated, will be useless as a guide, and can easily 



^ Stake, R. E. , and Denny, Terry, "Needed Concepts and Tech- 
niques for Utilizing More Fully the Potential of Evaluation," in 
Educational Evaluation; New Roles, New Means , National Society 
for the Study of Education Yearbook, LXVIII, Part II, 1969, p. 
377. 
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be changed without being noticed.^ Our findings clearly in- 
dicate the need to implement the recommendation: 

(8) THAT THE STATE DEPARTMENT TITLE I OFFICE PUBLISH 
GUIDELINES ON FORMULATION OF PROGRAM OBJECTIVES 



"Unfortunately, specifications which are implicit are diffi- 
cult to communicate to others, they are rarely analyzed and clearly 
revised, and they do not serve as clear guides to particular deci- 
sions or actions. Implicit specifications may shift without the 
educational worker |s being clearly aware of any change, and, because 
j communication, the attainment of the specifications may 
HTx attempt at systematic appraisal." The author continues. 

If the purposes and specifications for education are not explicit, 
then it is possible for them to be altered by social pressures, by 
fads and fashions, and by new schemes and devices which may come and 
go with momentary shifts on the educational scene. Implicit pur- 
poses are difficult to defend, and the seeming vacuum in purpose in- 
vites attack and substitution of explicit purposes by a constant 
stream of pressures and pressure groups." 

Excerpts are from the chapter on "Some Theoretical Issues Re- 
lating to Educational Evaluation," by Benjamin Bloom, in Educational 

Evaluation: New Roles , Newmans , National Society for the Study of 

Education Yearbook, Lxviii, Part II, 1969, p. 29. 

2 

Evalu ation of Title I Projects , published in Oc- 
Of i966 by the U. S. Office of Education (GPO 1966 0-236-150), 
outlines clearly the importance of behavioral objectives and how to 
formulate them. See page 8. 

3 

n*u r?® '"School -centered. Waterfront, Compared- to-what?' and 

2-i!?’" Educational Objectives," by Scarvia Anderson, in On Evaluatin g 
23 29 ^ P*^9rar(is , Educational Testing Service, Princeton, 1966, pp. 
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WHICH WILL INCLUDE AN ELABORATION ON THE FOLLOWING 
SUGGESTIONS: 

1. OBJECTIVES SHOULD BE GENERATED OUT OF ASSESSED 
NEEDS AND BE' FEASIBLE IN TERMS OF RESOURCES 
AVAILABLE 

2. OBJECTIVES SHOULD REFLECT A HIERARCHY OF PRI- 
ORITIES SO THAT RESOURCES, TIME, AND PERSONNEL 
CAN BE ALLOTTED ACCORDINGLY 

3. PROGRAM OBJECTIVES SHOULD BE CLEARLY STATED IN 
BEHAVIORAL TERMS THAT ESTABLISH PERFORMANCE 
CRITERIA FOR STUDENTS AND SPECIFIC SUCCESS CRI- 
TERIA FOR THE PROGRAM 

4. PROGRAM OBJECTIVES SHOULD BE DISSEMINATED TO 
ALL STAFF MEMBERS AND BE INCLUDED AS A PART OF 
THEIR PRE-SERVICE AND IN-SERVICE TRAINING SO 
THAT EVERYONE KNOWS HOW HE IS RELATED TO THE 
ACHIEVEMENT OF THE OBJECTIVES 

C. SELECTION OF PROJECT PARTICIPANTS 



11. WHAT CRITERIA WERE USED TO SELECT STUDENTS FOR TITLE 
I PROJECTS? 

Title I legislation is geared for a particular 
target population, namely those who are disadvantaged. 
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The purpose of this question was to determine to 
what extent and in what ways projects identified 
members of the target population and to see to 
what extent different projects reflect similar or 
dissimilar notions of the kinds of students who 
should be in Title I programs. Obviously, pro- 
ject objectives and plans should be geared to meet 
the needs of this population. 

A wide variety of responses were recorded on how children 
were selected to participate in Title I programs. Three types 
of responses were recorded, those referring to: 

1. Method of identification; 

2. Qualifications or priority characteristics; and, 

3. Actual criteria. 

The latter category includes only those characteristics 
of students which are necessary or sufficient for admission in- 
to the project. 

In most projects for which information was available, the 
teacher took part in identifying the children, either alone or 
in collaboration with other staff members, such as a school 
psychologist or reading specialist. Referrals from profession- 
als outside the school system were relatively uncommon, oc- 
curring in several summer projects and one winter project. In 
over half of the projects children were chosen partially or 
wholly because of poor classroom performance or low achievement 
test scores. 
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Low economic status was listed as a necessary qualifi- 
cation by several of the projects. In addition, this was a 
priority for two out of 14 summer projects for which data 
were available. Another way of viewing this qualification 
was to accept students attending a target school. This was, 
in fact, done by three summer projects and was a priority 
consideration for one other. One of the winter projects 
considered only emotionally stable youngsters and one took 
only those with I.Q.'s over 110. Two projects chose only 
students of mediocre I.Q. while one took only those whose 
achievement test scores were not high. One summer program 
gave priority to previous participants in the program while 
another did so to children of large or one-parent families. 
In two of the projects balance was a factor in selection. 

For instance, students of a particular sex were selected to 
create a male-fernale balance. In one project, a small num- 
ber of normal achievers were selected to have some kind of 
balance between underachievers and average achievers. 

Two of the summer projects were open to any who wished 
to come and therefore functioned very much as an ordinary 
summer school might function. For two winter projects and 
nine summer ones, no necessary and sufficient criteria were 
listed. Ten projects named poor classroom performance as an 
admission criterion while 14 projects gave low scores on 
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achievement tests as a criterion. Eight projects required a 
specific need for the service offered. One project was for 
mentally retarded and physically handicapped children. 

Other projects were limited to those who were considered 
underachievers and some were limited to those who were non- 
English speakers. 

Some of the above responses seemed to indicate question- 
able standards of selection from a legal point of view: low 

economic status was a necessary qualification for two of the 
projects; two other projects were open to all who wished to 
come; and, one only accepted children whose I.Q. scores were 
110 or better. 

Given the degree of teacher influence on selection, it 
is important to note that having found a lack of communication 
of explicit project objectives to project staff, it is ques- 
tionable whether or not the regular classroom teacher is in- 
formed well enough for making recommendations to the programs. 
Frequently the criteria for selection were not explicit, which 
is not surprising given the generality of objectives. For ex- 
ample, one project in the sample was having difficulties be- 
cause the persons making referrals to the program did not un- 
derstand the project's objectives. This project's objective 
was to bring children up to grade level and return them to the 
regular classrooms as soon as possible. However, because there 



were no special education classes In the community, some 
teachers selected slow and retarded children as the most 
disadvantaged group elegible to receive special help from 
the Title I project. The situation led to a frustration 
of the staff and students and lack of understanding and 
support from the community. Given this particular group 
of children, the objectives were unrealistic. Obviously, 

In this case selection criteria and objectives were not co- 
ordinated, but detrimental to all concerned. (See Appendix 
VI, pages 311-314. 

12. WHAT WERE THE DIAGNOSTIC MEASURES TAKEN, IF ANY? 

Diagnostic measures are important in assess^ 
ing needs and therefore useful in determining pro- 
gram objectives and content. 

The use of diagnostic testing In the selection of pro- 
gram participants was reported by over 1/2 of the projects 
from which data were available (40). Achievement batteries 
were used for diagnosis and selection by four summer projects 
and one winter project. Six projects used Intelligence tests 
as a diagnostic measure for selection. Several programs em- 
ployed one or more types of reading tests: oral reading tests 
were used by five projects; reading readiness tests were used 
by three projects; five projects used diagnostic reading tests 
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while one winter project used a test of reading capacity. 

Other tests used were in the areas of visual perception, 
dyslexia, speech, and vocabulary. There were also several 
locally made tests. 

RECOMMENDATIONS 

Our data indicate that, for the most part, projects are 
serving the appropriate population, but that resources could be 
even more efficiently utilized if greater care were taken to 
focus efforts to those needing it. This is a concern of the 
National Council on the Education of Disadvantaged Children and 
has been since the beginning of Title I.^ Current Title I 
guidelines are clear but perhaps too general to be of assistance 
to project personnel in selecting students.^ We recommend: 

(9) THAT MORE SPECIFIC GUIDELINES AND ASSISTANCE BE PRO- 
VIDED BY THE STATE DEPARTMENT TITLE I OFFICE TO LOCAL 
SCHOOL DISTRICTS FOR DETERMINING ELIGIBILITY FOR PAR- 
TICIPATION IN PROGRAMS IN ACCORDANCE WITH THE INTENT 

^ Report of the National Advisory Council on the Education of 
Disadvantaged Children « U. S. Office of Education fGPO Qn-A7«^^ 

March, 1966, p. 17; and. Fourth Annual Report of the Council. 1969. 
p. 43. 

^ Guidelines Title I of E.S.E.A. of 1965 . Department of Educa- 
tion, Bureau of Elementary and Secondary Education, Boston, Massa- 
chusetts, July, 1968, p. 2. 
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OF TITLE I LEGISLATION AND THAT THE TITLE I OFFICE CON- 
SIDER REQUIRING MORE DETAILED INFORMATION ON CRITERIA 
FOR SELECTING STUDENTS. 

In some of the summer programs, anyone was able to attend 
whether or not they met any special criteria. This appeared to 
be in violation of specific policies set by the U. S. Office of 
Education.^ We therefore recommend: 

(10) THAT SUMMER PROJECTS BE MORE CAREFULLY MONITORED TO 

INSURE THAT TITLE I FUNDS ARE NOT BEING USED TO FINANCE 
A REGULAR SUMMER SCHOOL WHICH CAN BE ATTENDED BY ANY- 
ONE AND WHICH SHOULD BE FINANCED BY LOCAL DISTRICTS. 

D. PROJECT EVALUATION 

13. WHAT KIND OF EVALUATION DESIGN WAS USED? 

Where possible, observers used the "X and O" 
format of Campbell and Stanley as reported in Gage's 
Handbook of Research in Teaching^ for describing the 



See memorandum from the U. S. Office of Education dated June 
14, 1968, on the subject of "Misuse of Title I Funds by Supplanting 
State and Local Funds." A copy of this memorandum may be found in 
the Title I Guidelines , p. 17. (See previous reference.) 

^ Campbell, Donald T., and Stanley, Julian C., "Experimental and 
Quasi -experimental Designs for Research on Teaching," in Gage, N.L. 
(Ed.) Handbook of Research on Teaching , Rand McNally & Co., Chicago, 
1963 . A modified form of the Campbell and Stanley code for describing 
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basic structure of evaluation designs used by the 
projects. We were interested to note the range of 
designs, if any, and their levels of sophistication, 
since the more sophisticated and appropriate the 
design, the better feedback for program improvement. 
Information was collected on whether or not the de- 
sign included comparison as well as treatment groups 
and, if so, how the comparison group was selected; 
whether or not treatments or conditions were applied 
or held constant throughout the project; whether or 
not there had been a differential loss of respondents 
from the comparison groups; and, whether or not the 
comparison group was in a parallel program. 

One aspect of some projects' organization made 
them more difficult to evaluate than others, namely, 
the involvement of a cooperative arrangement with 
several institutions, particularly those that were 
non- public. Inquiry was made to glean information on 
how the evaluation was carried out in these kinds of 
projects and who did it. 

If the evaluation design adopted a specific mea- 
surement procedure utilizing pre- and post-tests , in- 
formation was collected to determine whether or not 
project personnel considered the importance of making 
certain that nothing other than the experimental vari- 
ables occurred between the first and second measure- 
ments unless accounted for in some way. 

Inquiry was also made to ascertain whether or not 
project directors or evaluators made any systematic 



the evaluation designs was used, in which X = exposure of a group to 
an experimental variable or event (treatment) and 0 = process of ob- 
servation or measurement. The graphic presentation of the design can 
be used to analyze experimental strengths and weaknesses of the evalu- 
ation in respect to project concerns. 
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attempt to describe and measure any of the charac- 
teristics of the physical and social environment 
which were thought to be relevant to the outcomes 
of the project, 

^^eguently happens that a project evalua- 
tion focuses only on one or two aspects of the pro- 
gram, Thus f note was taken if there were any pro— 
jGct activities which were thought to be meaning- 
ful that were not included in the evaluation. 

Since some program effects may not be felt for 
a year or more, note was made of all longitudinal 
investigations of Title I efforts and all programs 
which included efforts to follow each student over 
more than a period of a year. 

Finally f it was determined whether or not the 
project planners or evaluators had devised and were 
using a schedule, such as PERT charting, for the 
evaluation process itself. 

Out of 37 projects from which data were available, 16 pro- 
jects reported no evaluation design. Out of our sample, only 
8 winter projects and 13 summer projects had some kind of evalu- 
ation design. The most common was the simple pre-test, post- 
test design (0X0) used by 5 winter and 12 summer projects. 

In addition, this design was used for parts of one other winter 
and one other summer project. Three projects used a repeated 
observations format (0 X 0 X 0 X 0) during the program, while 
one project used the same format on a year-to-year basis. The 
pre-test only (OX) and the post-test only (X 0) designs were 
each used once. A sophisticated pre-test, post-test control 
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group design was used in one summer project, the control group 
having been selected from schools on the periphery of the 
target area. In this case, the evaluators agreed that pre- 
test, post- test arrangements in a summer program cannot yield 
reliable gain scores. According to local officials, such test- 
ing was done only because it was required by the Community Ac- 
tion Agency and the State Department. 

In the case mentioned above, the comparison groups were 
selected because they were considered to be comparable in 
basic demographic characteristics, while at the same time hav- 
ing no special Title I programs. Treatment conditions were 
applied and held constant throughout the program; there appeared 
to be no differential loss of respondents from the comparison 
groups. 

Having evaluation designs which include no control group 
represents a major obstacle in discovering the value of Title I 
programs as compared to what is offered by the regular school 
program, not only for disadvantaged children, but for the total 
school population as well. 

Out of 40 projects from which data were available, no pro- 
ject made any attempt to measure quantitatively any characteris- 
tics of the environment thought to be relevant to the concerns 
of project objectives.^ Ten projects made some kind of an 

^ See Wolf, Richard, "The Measurement of Environments," Proceed- 
ings of the 1964 Invitational Conference on Testing Problems (Prince- 
ton, N.J: Educational Testing Service, 1965) pp. 93-106. 
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attempt to describe characteristics of the environment which 
were considered to be important in achieving project objec- 
tives. 

Only one project out of 38 for which data were available 
gave consideration to the evaluation problem of making cer- 
tain that events other than those which had been specifically 
designated as part of the Title I treatment were controlled 
in some way and did not affect results of pre- and post-tests. 

Thirty-one projects out of those from whom data were 
available (37) reported no schedule set up for the evaluation 
process. Three projects had set test dates and evaluation form 
submittal deadlines while three others indicated they did have 
a kind of rough schedule to go by. In no case was PERT (Pro- 
gram Evaluation Review Technique) charting reported. 

In our sample, only 2 projects out of the 40 from which 
data were available were listed as cooperative projects and only 
13 involved non-public school participation.^ Two of these 
projects had no evaluation to speak of. In the remaining pro- 



Our data are consistent with the finding of the National Ad- 
visory Council on the Education of Disadvantaged Children. They 
found that "non-public school officials are rarely included as ac- 
tive consultants in Title I planning and evaluation despite federal 
guidelines and despite the contribution they might make in strength- 
ening their city's overall program." Fourth Annual Reoort on Title 
X, 1969, p. 41. 
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jects, evaluation was done by the public school staff, with 
all students being included in one evaluation. There is thus 
no real evidence of cooperative evaluation and very little of 
the parochial school takes part or benefits from the process. 

Out of 37 projects from which data were available, 15 in- 
dicated that provision was made for some kind of follow- 
through on Title I children from year-to-year. In 22 of the 
projects, no follow-through was evident." 

Observers noted a lack of communication from summer pro- 
jects to the regular school year. In many cases, the com- 
munication was an informal conversation among interested tea- 
chers. Few regular school year teachers, except those hired 
for the summer have observed summer activities. In those sum- 
mer projects where children were selected late in the year or 
came on a volunteer basis, there was nearly always a lack of 
basic information from the regular school files. Some pro- 
jects made a point of having records available while others had 
not considered it or had decided against it. In general, follow- 

^ The 1968 Massachusetts Evaluation Report on E.S.E.A. Title I 
Activities (Bureau of Elementary and Secondary Education, State De- 
partment of Education, December, 1968) indicates that this has been 
a problem, but that "folders, test data, and progress reports de- 
veloped on project pupils during the summer must be forwarded to 
their school-year teachers so that the teachers can be alert to the 
particular needs and individual progress of these children." (p. 12) 
Our data indicate that this is generally overlooked. 
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through from year-to-year or from summer to winter has not 
been very systematic or successful. 

There seems to be a division of opinion and a complex 
philosophical question concerning the issue of follow-through 
with the Title I children. With funding remaining basically 
at the same level or declining each year, local education 
agencies must choose between serving the same age levels each 
year or following through on the children who are served by 
the project during the first year over a period of several 
years, thereby advancing the grade level of the program with 
them, or perhaps some combination. Some project directors 
purposely recruited the same children for consecutive summers 
while others set an opposite policy. 



14. WHAT MEANS WERE USED TO MEASURE STUDENT PERFORMANCE? 

All standardized tests used in measuring student 
performance were tabulated; locally made tests were 
collected or described; and, other sources and methods 
of collecting information such as questionnaires , 
logs, attendance records, anecdotal records, and un- 
obtrusive measures were described and their source 
noted, i.e., staff members, community agencies, par- 
ents, or students. We also inquired as to whether or 
not tests were given regularly within the school or 
whether or not there was special testing in the Title 
I project itself. Of particular concern here was 
finding out whether or not there were any types of 
baseline data available that were different from pre- 
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tests and in what way these data were used. In- 
formation was also gathered on: the relationship 

of data collected to project objectives; whether 
or not consideration was given to the reliability 
and validity of the tests used/ whether or not 
evaluators were sensitive to the fact that changes 
in observers, scorers, or calibration of measuring 
instruments can influence changes in the obtained 
measurements/ and, grading policies. 

Thirty- two projects out of a sample of 43 (74^) used 
standardized tests for evaluation of student progress. These 
figures do not include testing done as a means of selecting 
project participants. The 74% figure given includes stan- 
dardized tests which were given as part of the regular school 
testing program as well as any special testing which might 
have been given especially for Title I evaluation. 

Achievement batteries were most popular in both winter 
and summer projects. They were administered in about 1/3 of 
the projects using standardized tests. Sixteen projects used 
some type of reading test, including achievement, diagnostic, 
and oral reading tests. Intelligence tests, individual and 
group, were administered in several projects. Less usual kinds 
of standardized tests used included: perception tests; motor- 
proficiency tests; personality, social and emotion behavior 
tests; and drop-out identification tests. It should be noted 
that when a project is reported as giving standardized tests, 
they were not necessarily used with all students in a given 
project. 





: 



1£9 



Testing of teachers was almost entirely lacking.^ One pro- 
ject did use a standardized attitude test for teachers and a 
classroom observation schedule for teachers. The use of Instru- 
ments devised by the school system was not mentioned at all by 
the winter projects and by only 4 summer projects. Question- 
naires, uniform subject matter tests, progress reports and anec- 
dotal forms were noted. It is quite likely that there is a 
greater use of such instruments than our data indicate, because 
school personnel often did not think to mention such types of 
measurements in response to questions concerning evaluation. 

Lack of testing In the areas of self-concept and attitude 
was clearly evident, particularly in light of the frequency with 
which the stated objectives of the projects Included some kind 
of Improvement of self-concept and attitudes. There is no doubt 
that It is more difficult to measure changes In self-concept and 
attitude than practically any other form of academic achievement, 
but there has been progress made in this area which should be 
disseminated to project planners and evaluators.^ 

^ Project planners and directors rarely think of teacher evalua- 
tion, yet teachers are recognized as the chief determinant of success- 
ful programs. Obviously, some attention needs to be given to this 
oversight, delicate though it is. 

^ The Massachusetts Title I Evaluation Report for 1 968 makes ref- 
erence to evaluation problems In this area. Considerable work remains 
to be done. Much of this will be dependent upon research efforts on 
the part of institutions of higher learning. (See page 15 of the Re- 
port. ) 



It is not our purpose to comment on the quality of stan- 
dardized tests being used. Most of them have received objec- 
tive reviews in journals, The Mental Measurements Yearbook J 
and similar other sources. It is, however, our obligation to 
raise the question of applicability of the testing being car- 
ried out to the actual objectives of projects. Observers fre- 
quently noted that, in general, most project staff members did 
not consider testing done in the name of project evaluation di- 
rectly pertinent to their use, but more as a necessary exer- 
cise for State Department and federal uses. Considerable time, 
money, and effort is going into testing. The meaningful ness 
and usefulness of this effort in relationship to the individual 
Title I project is questionable and needs a good deal of fur- 
ther study. A better understanding of the total measurement 
problem in relationship to project objectives and program evalu- 
ation is required before more effective measurements can take 
place. (Please see Appendix VI, page 317, for further details 
on standardized tests used.) 

Data on the performance of children from previous years 
was recorded as available in 31 out of 38 projects from which 
data were available. This, however, is in no way an indication 



Buros, 0. K. (Ed.) The Sixth Mental Measurements Yearbook . 
Highland Park, N. J: The Gryphon Press, 1965. 
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that It was being used. This question was Intended to find 
out If such Information were on hand, since It Is generally 
one of the best sources of comparative data which might be 
used In evaluation. In many projects awareness of how data 
already being collected could be used to strengthen the 
Title I evaluation design was lacking. 

Since project objectives were not stated In behavioral 
terms and were in some cases vague and misleading, and writ- 
ten and spoken objectives differed, questions concerning the 
relevance of measurement to objectives did not always pro- 
duce clear-cut responses. Sixteen out of 39 projects from 
which data were available felt that the data they collected 
were relevant to project objectives. It was evident that In 
23 of the projects, data could not be regarded as specifi- 
cally relevant to project objectives. 

Most projects were using standardized tests and were un- 
concerned as to the reliability and validity with regard to 
the Title I population. For those few tests which were local- 
ly made, no effort was made to establish validity or reliabil- 
ity. Since comparison groups were not evident and assuming 
this indicates that the testing purpose is to check progress 
of the Title I population only, then more attention needs to 
be given to these considerations. 

Only two out of 38 projects from which data were available 
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gave consideration to the fact that changes in observers, 
scorers, or calibration of measuring instruments may in- 
troduce biases into measurement results. Considerable 
use of checklists, multiple observations, etc., makes this 
question all the more pertinent, but at the same time it 
was generally unnoted. For example, one summer project 
used a rating list three times in the summer for each 
child. Each time the checklist was marked, it was done 
so by a different teacher. This, of course, illustrates 
the problem of rater consistency and is one example out 
of mf^ny of how lack of sophistication in evaluation may 
permit procedures which introduce so many biases that eval- 
uation results cannot be considered acceptable. 

Twenty-two out of 35 projects from which data were 
available did not make any use of unobtrusive measures.^ 

In one project the principal noted a decline in office vis- 
its among project students. Comparative attendance records 
were also user! as a means of determining project success. 
Use of more unobtrusive measures should probably be encour- 
aged. They can probably be relatively unsophisticated and 



For a full exposition on this subject, see Unobtrusive 
jteasure: Nonre active Research on the Social Sciences /bv Webb. 

Campbell, Schwartz, and Seckrest, Rand Mclially i Company , 
Chicago, 1966. 
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yet very meaningful when used particularly In combination 
with more traditional kinds of measures.^ 

In 14 out of 40 projects from which data were avail- 
able, no attempt was made to solicit suggestions for the 1m 
provement of the project. Of the 26 projects which did ask 
for suggestions, most asked members of their own staffs, 
six asked parents, and five consulted with students. Only 
one project reported soliciting any suggestions from e com- 
munity organization. In most cases, the solicitation was 
extremely Informal and therefore not too likely to be taken 
seriously by the one from whom Information was solicited. 



"Whatever the level of training, we need evaluators who 
are facile In using unobtrusive measures for data collection as 
well as In Indexing programs through more traditional measures. 
Educational evaluators must understand the fallibility of tests 
and of less traditional avenues of assessment and be able to 
conceptualize assessment problems related to process and outcome 
In a variety of ways. The argument for the use of unobtrusive 
measurements In educational evaluation rests on the presumption 
that It Is possible to select a group of measures which have com- 
pensatory strengths and unshared weaknesses. Traditional educa- 
tional research measures and unobtrusive measures are comple- 
mentary to one another and not Intersubstitutable In the train- 
ing of educational researchers." 

See Robert E. Stake and Terry Denny, "Needed Concepts and 
Techniques for Utilizing More Fully the Potential of Evaluation," 
In National Society for the Study of Education Yearbook, LXVIII, 
Part li, 196d, p. fTT. 
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Increased effort in this area is needed, including the for- 
malization of procedures for making suggestions and their 
subsequent consideration by project officials. This would 
broaden the base from which suggestions are solicited and 
bring several perspectives to bear upon the evaluation pro- 
cess. 

In regard to the question of grading, only one summer 
project out of 18 used grades as a means of evaluating in- 
dividual student performance. From informal conversations, 
observers noted that teachers were generally pleased with a 
no-grading philosophy for Title I children.^ Generally 
speaking, instructional staff felt concerned that disadvan- 
taged students meet with success and that they feel positive- 
ly about their ability to achieve. Instead of grades, there 
was usually some kind of informal, ongoing feedback to the in 
dividual student on his performance. Data from the winter 
projects indicate indecision on grading policies on Title I 
children during the school year. More winter projects graded 
than did not. Of those who graded, the majority used the 
same grading philosophy as the school system of which they 

^ Although a no-grading philosophy may have special applica- 
tions for teaching the disadvantaged, some kind of continual feed 
back is important for the child. See the section on "Appraisal" 
in The Conditions of Learning , by Robert M. Gagne, published by 
Holt, Rinehart & Winston, 1964, p. 227. 
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were a part. Some mentioned using grading philosophies that 
were different than that used by the regular school system, 
one specifically indicating that grading in Title I was "easier." 



15. H(m WERE DATA ANALYZED? 

Information was obtained on how the data were 
analyzed and by whom; what statistical procedures 
were used in the treatment of the data; whether or 
not evaluators took into consideration that measure- 
ments of groups selected on the basis of their ex- 
treme scores may reflect in their post-tests a sta- 
tistical regression toward the mean; whether or not 
evaluators took into consideration the fact that 
normal maturation will produce within each student 
a degree of progress related to nothing else other 
than the function of the passage of time. 

Although great quantities of data were collected by many 
projects, these data were often not analyzed or utilized. Out 
of 36 projects from which data were available, 22 made little 
or no effort to analyze data. This figure includes those who 
collected no data in the first place. Ten out of the 36 com- 
puted gains scores in terms of grade equivalencies; one plotted 
simple graphs on some kinds of performance measures, but with 
no sophistication in analysis of data techniques. One project 
used a co-variate analysis for comparison with a control group 
as a part of their own evaluation. Only two projects out of 
40 from whom data were available took into account regession 
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effect when analyzing dataJ An example of a project which 
did not take it into account was one which used Spring test 
scores as a major selection criterion, but also as a pre- 
test. Title I students therefore represented test scores 
which deviated significantly from the mean. Program treat- 
ment effects notwithstanding, one can expect a regression 
toward the mean. 

Most evaluators also did not take into account a general 
maturation effect when analyzing data. Five projects indi- 
cated that they had been aware of the effects of general matura- 
tion and fewer than that took any concrete steps to allow for 
it when analyzing and interpreting data on gains scores. 



16. WAS THERE ANY ATTEMPT TO RELATE THE PROJECT RESULTS 
WITH THE NEEDS ASSESSED? 

If project results are not filling assessed 
needs f then xt is clear that jnodificstlon must be 
introduced into the program. 

Out Of 36 projects from which data were available, only 10 
made systematic attempts to relate project results with the needs 



A 9ood article on the Importance of taking regression effects 
into account is The Measurement of Change," by Frederick M. Lord. 

Tesfr nrSey^iie^ ‘ * P' Published by Educational 
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assessed and 1n many of these this was not a part of any 
official procedure set up as a part of a given project's for 
mal evaluation component. Generally speaking, this repre- 
sents one of the missing links In the continuous process of 
program evaluation leading Into program modification.^ 



RECOMMENDATIONS 

It Is clear that good evaluation Is the sine qua non of pro- 
gram Improvement. There Is little hope of Insuring good evalua- 
tion unless adequate time and resources are allocated for this 
purpose. Above all, qualified personnel are required. Given the 
scarcity of trained evaluators. It Is all the more Important for 
this kind of expertise to be present In the Title I Office.^ Al- 



^ The National Advisory Council on the Education of Disadvan- 
taged Children reports that the most frequent reason for program 
failure Is "Instruction Irrelevant to the stated objectives of the 
programs." Fourth Annual Report on Title I . 1969, p. 23. 

2 

It Is a natural sentiment to have reservations about really 
sound evaluation because It will reveal shortcomings and take away 
excuses for continuing In the same old way. Donald Campbell ex- 
presses the situation clearly: "It Is one of the most character- 

istic aspects of the present situation that specific reforms are 
advocated as though they were certain to be successful. For this 
reason, knowing outcomes has Immediate political Implication. Given 
the Inherent difficulty of making significant Improvements by the 
means usually provided and given the discrepancy between promise and 
possibility, most administrators wisely prefer to limit tne evalua- 
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though the State report for 1968^ Indicates a growing sophistica- 
tion In evaluation (and we have seen some evidence for this), our 
data nonetheless clearly Indicate a great need for a general up- 
grading of the evaluation process employed by project directors. 

We therefore recommend: 

(11 ) THAT THE TITLE I STATE DEPARTMENT OFFICE RETAIN TWO OR 
MORE FULL-TIME PROFESSIONALLY QUALIFIED PROGRAM EVALUA- 
TORS WHO CAN BE ASSIGNED THE RESPONSIBILITY FOR REVIEW- 
ING THIS ASPECT OF ALL P:^0P0SALS, MONITORING THE EVALUA- 
TION PROCESS OF THE PROGRAMS, AND FOR HELPING TO MOBI- 
LIZE EVALUATION RESOURCES TO ASSIST LOCAL DISTRICTS AS 
NEEDED.^ 



tions to those the outcomes of which they can control, particularly 
Insofar as published outcomes or press releases are concerned. Am- 
biguity, lack of truly comparable comparison bases, and lack of con- 
crete evidence all work to Increase the administrator's control over 
what gets said, or at least to reduce the bits of criticism In the 
case of actual failure. There Is safety under the cloak of Ignor- 
ance." No doubt this statement speaks to administrators of local pro- 
jects and the Title I Office In the State Department, but it Is par- 
ticularly true In our case, since what we advocate (especially In the 
section on training programs), though based on research, nonetheless 
has never been tried out systematically on any significant scale. 

Yet, It will be critically Important for any such efforts to be rig- 
orously evaluated, political vulnerability notwithstanding. See D. T. 
Campbell, "Reforms as Experiments," American Psychologist , vol. 24, 
no. 4, April, 1969, p. 409. 

^ Massachusetts Evaluation Report on E.S.E.A. Title I Activities, 
1968, p. 33. 

2 

One percent of the State allocation for Title I can be used by 



since State agencies are frequently not able to compete for 

adequately trained staff J particularly In the area of evaluation, 
we suggest: 

(12) THAT THE TITLE I STATE DEPARTMENT OFFICE ESTABLISH CON- 
TRACTUAL AGREEMENTS WITH BUSINESS OR INSTITUTIONS OF 
HIGHER LEARNING TO PROVIDE TRAINING AND/OR CONSULTANT 
SERVICES TO EVALUATION STAFF MEMBERS ON THE LOCAL LEVEL 
OR ENCOURAGE LOCAL DISTRICTS TO DO SO.^ 



(13) THAT SPECIFIC ENCOURAGEMENT BE GIVEN TO LOCAL EDUCA- 
TIONAL AGENCIES TO APPOINT PAID EVALUATORS TO TITLE I 
PROGRAM STAFFS AND THAT IT BE MANDATORY THAT THESE 
EVALUATORS BE INCLUDED ON THE PUNNING STAFF. 



programs, in Mas'iachusetts this 
$167,965 In fiscal year 1968-69. During last year, only 

Tknc returned to the. federal government. 

Thus, this recommendation Is not unrealistic from a financial point 
Of view. ^ * 

0^ our recommendations Involve the State Department 
^ useful for those unfamiliar with the opera- 
® description of It. Please see 

Appendix VIII, page 343. 

2 

In the section on Compensatory Education, the Wlllls-Harrlnq- 
ton Report recommends that "consultant staff should be provided 
through the Division of Curriculum and Instruction essential to uni- 
fying, coordinating, and strengthening compensatory education programs 
and services." See page 44. 
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(14) THAT THE STATE DEPARTMENT OF EDUCATION ORGANIZE A 
POOL OF UNIVERSITY CONSULTANTS WHO CAN BE DRAWN UPON 
BY LOCAL DISTRICTS FOR ASSISTANCE IN PLANNING, IMPLE- 
MENTING, AND EVALUATING THEIR PROJECTS.^ 

(15) THAT PART OF THE FUNDS FOR TITLE I PROGRAMS SHOULD BE 
MADE AVAILABLE TO PROVIDE RELEASE TIME FOR POTENTIAL 
TITLE I STAFF MEMBERS FOR PLANNING, EVALUATION, PRE- 
SERVICE, AND IN-SERVICE TRAINING. GUIDELINES SHOULD 
SPECIFY THIS AND SUGGEST VARIOUS KINDS OF ARRANGEMENTS 
FOR DOING IT. 

With the possibility of adequate assistance being offered, it 
becomes reasonable to establish the requirement embodied In the 
racommendation: 

(16) THAT SOUND EVALUATION DESIGNS BE CONSIDERED A REQUIRED 
PART OF THE PROPOSAL FOR FUNDS AND THAT NO PROJECT BE 
FUNDED IF IT DOES NOT HAVE AN ACCEPTABLE EVALUATION DE- 
SIGN. 



The Massachusetts Advisory Council on Education and the Title 
I Office In the State Department have already acted on this recom- 
mendation. Consultants from various Institutions of higher learn- 
ing have been Identified and already brought together for a discus- 
sion of their responsibilities. Lists of these consultants and 
their addresses have been made available to all Title I programs. 





Evaluation has always been required for Title I,^ but too 
loose a definition of evaluation has been applied in approving 
and monitoring projects. Good evaluation requires financial sup- 
port. In many cases more resources than are currently permissi- 
ble may be needed. We recommend: 

(17) THAT THE STATE DEPARTMENT SEEK, THROUGH WHATEVER APPRO- 
PRIATE MEANS, TO HAVE FISCAL POLICIES RELATED TO ALLO- 
CATIONS FOR EVALUATION CHANGED TO ENCOURAGE MORE SUB- 
STANTIAL SUPPORT FOR EVALUATION.^ 

To upgrade further the quality of evaluation, we recommend: 

(18) THAT SPECIFIC GUIDANCE THROUGH THE TITLE I STATE DEPART- 
MENT OFFICE (WHICH MAY FIND IT HELPFUL TO DRAW UPON 
CONSULTANTS FROM APPROPRIATE UNIVERSITY DEPARTMENTS) BE 
GIVEN TO LOCAL DISTRICTS WHO ARE PLANNING A TITLE I 
PROGRAM ON: 



See Title I Guidelines, Section J on Evaluation, p. 22. 

^ It should be noted that E.S.E.A. Title III (PACE) brings 
about $5 million into Massachusetts annually as opposed to the $16 
million provided by Title I. Title III permits the State agency 
a much larger administrative budget (up to 5% as opposed to 1^). 

If Title I projects are to have well -designed evaluation programs, 
more staff support in this area will be needed. 
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(a) MODELS OF ACCEPTABLE EVALUATION DESIGNS 
AND PROCEDURES;^ 

(b) WHAT KINDS OF TESTS AND MEASUREMENTS ARE 
VALIDATED AND APPROPRIATE (PARTICULARLY 
IN THE AREAS OF SELF-IMAGE AND ATTITUDE 
CHANGE) TO USE IN CONJUNCTION WITH GIVEN 
PROGRAM OBJECTIVES;^ 



« *4 f!'' example, many new designs, such as the regression dis- 
continuity design, have begun to appear, several of which should 
be made known and used, particularly In the case of the evaluation 

Regression Discontinuity 

te ? T. canp- 



I as 

bell, published In the American Psycholog ist 
April, 1969, p. 419. This design nas direct 



vol. 24, no. 4, 
relevance to the eval- 



j • ^ iiiia riaa Ulr' 

uatlon of programs for the disadvantaged. 

^^® Psychological Study of Social Issues 
CSPSSI) has published a special supplement. Guidelines for Testina 
gorily Group'chlldren, which appears In thi ^ournal of Social 

^a*kII°‘ u 4 available Trom 5PSSI, p.O. 

Michigan. Collection and dissemination of 
of publications would make a good beginning. This recom- 

If ^ ^commendation of the National Advisory Coun- 
cll on the Education of Disadvantaged Children that: 

Professional educators and social scientists should Intensify 
a review of current achievement tests to further reduce 'culture ^ 
bound components that are biased against the disadvantaged child 
and conc®al Indications of his true, latent ability; and, that these 

tIStrfnS"?!? "”''® cognitive achievement 

realms— self-concept, creativity, motivation, 

®^“cat1on may have equally Important 
rSimrn 2« Ih Fourth Annual Report of the National Advisory 

Council on the Education of Disadvantaged Children, Title I - E.S E A» 
AJtevlew and a Fbr^ard innir - 19^9 (Qpo 0-331-373), pT B? 



(c) TYPES AND METHODS OF USING UNOBTRUSIVE 
MEASURES;^ 

(d) HOW TO ANALYZE, USE, AND STORE DATA SO 
THAT THE INFORMATION IS HELPFUL IN INTRO- 
DUCING MODIFICATIONS TO IMPROVE THE PRO- 
GRAM; 

(e) WAYS OF HANDLING EVALUATION IN THE CASE 
OF JOINT OR COOPERATIVE PROJECTS, PARTIC- 
ULARLY THOSE INVOLVING NON-PUBLIC SCHOOLS;^ 
AND, 

(f ) PERT CHARTING OR SOME OTHER SIMILAR DEVICE 
FOR SETTING UP AND MONITORING THE EVALUA- 
TION PROCESS.^ 



^ Webb, Eugene T. , et.al. , Unobtrusive Measure ; Nonreacti ve 
Research In the Social Sciences, Rand McNally & Company, Chicago, 
T555: 

The National Advisory Council on the Education of Disadvan- 
taged Children has expressed concern for non-public school partici- 
pation. They recomnend that "the U. S. Office of Education should 
continue to urge the Involvement of non-public school officials In 
the planning and evaluation of Title I programs." See whole sec- 
tion on "Participation of Non-public School Children," pages 5-6 of 
Fourth Annual Report, Title I, 1969. 

O 

Cook, Desmond, Program Evaluation and Review Technique; Ap- 
plications In Education , U. S. Office of Education, 1966. 



Putting theory into practice and ascertaining its efficacy 
over a long period of time is of primary importance. Our data 
indicate that such demonstrations are needed and would be ex- 
tremely useful for ongoing projects. They would undoubtedly 
serve as a powerful stimulus for modifying and improving many of 
the projects which are repeated annually. We therefore recommend: 

(19) THAT THE TITLE I STATE DEPARTMENT OFFICE CONSIDER 

SETTING UP A SAMPLE OF PROJECTS FOR LONGITUDINAL EVAL- 
UATION OF THE EFFECTIVENESS OF TITLE I PROGRAMS. 

THIS WOULD NECESSITATE DETERMINING THE KINDS OF DATA 
TO BE COLLECTED AND ASSISTING LOCAL DISTRICTS IN 
SETTING UP AN APPROPRIATE SYSTEM FOR COLLECTING AND 
STORING THE DATA. OF PARTICULAR CONCERN HERE ARE: 

THE COMPARATIVE EVALUATION OF PAIRED MODELS OF TITLE 
I PROGRAMS WHICH VARY ON ONE DIMENSION, SUCH AS THOSE 
PROGRAMS SERVING THE SAME AGE GROUP EACH YEAR COMPARED 
TO THOSE FOLLOWING-THROUGH ON THE SAME STUDENTS FOR 
SEVERAL CONSECUTIVE YEARS AS STUDENTS CHANGE FROM ONE 
GRADE TO ANOTHER; THE COMPARATIVE MERITS OF SUMMER VS. 
WINTER PROJECTS; THE COMPARATIVE MERITS OF HIGHLY STRUC- 
TURED VS. A GENERAL ENRICHMENT, RELATIVELY UNSTRUCTURED 
APPROACH; AND, WAYS OF DETERMINING HOW VERY SMALL ALLO- 
CATIONS OF FUNDS CAN BE MOST EFFECTIVELY USED. 



E. PROGRAM MODIFICATION 



17. »HAT IS THE FORM OF THE EVALUATION REPORT AND DOES 
IT DISCUSS IMPLICATIONS FOR MODIFICATION? 

The form of the report is often a powerful 
determinant as to how it will be used. We were 
interested to note: whether or not evaluation re- 

ports were turned in merely as a fulfillment of a 
requirement of the State Department or whether or 
not the report took on different forms which might 
make it maximally useful to project staff members 
in modifying certain aspects of the program; and, 
whether or not it contained a discussion of impli- 
cations or recommendations for modification. 

Approximately 1/5 of the projects responding to questions 
on their evaluation reports Indicated that they had none.. 

Since the State Department Is required by law to receive such 
a. report. It Is likely that someone other than those directly 
related to the project writes the report or that the staff of 
a current project did not have this assignment. 

Data on whether or not reports discussed Implications or 
made recommendations for modifications were scant. Out of 15 
projects from which data were available, all Indicated that the 
report did not go Into a discussion of Implications for modifi- 
cation. 

Generally speaking, these results point to the fact that 
the evaluation report Itself Is not set up to be used as a 
vehicle through which modification might be Implemented. 
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18. WHAT WERE THE CHARACTERISTICS OF THE DISSEMINATION 
OF EVALUATION RESULTS? 

Since the decision to modify a pzogzaia ought 
to be based on evaluatioUf we weze intezested to 
find out how evaluation zesults weze disseminated s 
who got the zepozt; when the zesults weze communi- 
cated/ whethez oz not theze was a fozmal mechanism 
in opezation so that upon the analysis of feedback, 
the pzoject could be quickly modified (i.e., thzough 
weekly meetings to discuss pzoject pzogzess) / whe- 
thez oz not the evaluation was used in zeplanning 
a pzoject; whethez oz not infozmation on the pzo- 
gzess of individual childzen who weze zemoved fzom 
the zegulaz classzoom was zepozted to theiz regu- 
lar classzoom teachez in any systematic way; and, 
whethez oz not techniques, matezials, and teaching 
appzoaches used in Title I pzojects had been communi- 
cated to the zegulaz school pzogzam and whethez oz 
not they had been incozpozated into the zegulaz 
school pzogzam. 

ThG timing of dissemindtion of thG GVdluBtlon roport vdriGd 
widely from project to project. In most cases there was no set 
time which occurred year after year In a given project. Many 
received It shortly after the end of the project, several six 
months after the conclusion, and some were able to have It only 
upon request at any given time. Only one out of 37 projects for 
which data were available Indicated that the teaching staff re- 
ceived the evaluation report Itself. The most frequent recipient 

was the State Department, followed by the school board and/or the 
superintendent. 
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About half of the projects in the sample had a feedback 
mechanism in operation for rapid modification of the program. 
Generally, these were of a staff meeting nature. Only two 
winter projects gave a positive response to this question, 
leaving one to suspect that in a short program and one not 
competing with regular school programs, more direct attention 
is paid to facilitating feedback. Whether such mechanisms are 
utilized is not covered here, but rather that the opportunity 
is present. Most of the observers agreed that project staff 
tended not to think of evaluation as a continuous process but 
rather as something that occurs as an end-of-the-year activity. 

Our data are scant on the question of communication be- 
tween Title I teachers and regular classroom teachers in re- 
gard to individual Title I children. Generally speaking, when 
a child is removed from a classroom for Title I services, the 
general consensus seems to be that most Title I teachers do 
communicate with the regular classroom teachers but this is 
often informal and unsystematic. On occasion this did provide 
the means by which some modification could be produced, but 
again this depended upon individual initiative and was some- 
thing not built specifically into the program with administra- 
tive support and supervision. As to whether or not Title I ac- 
tivities were adopted into the regular school program, 21 pro- 
jects out of 37 reported that innovations, ideas, or materials 
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first used in Title I were later picked up by the regular 
program. Sixteen out of the 37 projects indicated that 
there had been no adoption of Title I activities into the 
regular program. Thus, there is evidence for the positive 
effects of dissemination, even though they are taking place 
slowly. This is an intended, by-product of Title I, since 
good compensatory education is in many ways a good model 
for high quality education in general. Our data indicate 
that it has been easier for materials and equipment to be 
utilized by the regular program rather than teaching ap- 
proaches and personnel, but there is some evidence of this 
as well. Some of the activities first adopted by Title I 
programs and now evident in the regular school program in- 
clude new materials and techniques, specialists and special 
programs, second language programs, summer school in general, 
and the adoption of less rigidly structured regular school 
programs during the winter due to the experience with the 
summer, and use of teacher aides. (See Appendix VI, page 323, 
for tabulation o ) 

19, WHAT WEBE THE OPINIONS OF PROJECT DIRECTORS AND 
STAFF MEMBERS CONCERNING THE SUCCESS AND/OR VALUE 
OF THE PROJECT? 

We were interested to find out the opinions 
of project directors and staff members on the 
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effectiveness of the projects and to determine 
the extent to which there was inter-staff agree- 
ment. Staff members were asked what changes they 
would make if they were to start the program from 
the beginning again and whether or not any of the 
changes they would like to make had been incorpor- 
ated or were going to be incorporated when the 
program is replanned. They were asked to indicate 
some of the chief negative outcomes of the project 
which were not anticipated, whether or not these 
were reported in the evaluation report and what 
were some of the unanticipated positive outcomes 
of the project and whether or not these were incor- 
porated into the report. 

There wa$ such a diversity of replies to the question, 
"What changes would you make 1f you were starting from the be 
ginning?" that no specific pattern emerged. The following se 
lected responses are reflective of that diversity: 

Strengthening of self-concept should be more empha- 
sized 

Addition o’f pre- service training 
Should use homogeneous groupings to facilitate 
learning 

Have students for the first two periods in the 
day rather than 1n the afternoon 
Start with younger children 
Hire more experienced teachers 
Utilize more teacher aides 
Have a better test selection 
Cut connections with 50/K of the outside agencies 
Have more diagnosis of specific problems 
Add a director of evaluation 
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Have better classroom monitoring 

Have more planning time 

Remove restrictions from E.S.E.A. monies 

Have more guidance from the director 

Have more money 

Have more field trips 

Have more time 

Out of the 24 projects from which data were available, one 
indicated that the changes that had been desired were made. Eight 
projects indicated that the changes were not made, while five were 
fairly certain that the changes would be made next year on replanning. 
Three projects felt that the changes were not possible and therefore 
there was no hope that there would be a change. 

It is reasonably clear from our data that staff members in 
general were aware of the need to make modifications and although 
there were many suggestions made, few of them had been imple- 
mented. Since many of the changes would entail having more financial 

support, many project personnel felt that the changes would not be 
forthcoming. 

Data were gathered from 31 projects in the sample relative to 
unanticipated negative outcomes. Again, responses were highly diversi- 
fied. Sixteen of the projects felt that there were no unanticipated 
negative results. Others listed were as follows: 

^tional ly disturbed chil dren caused too much trouble 
Children were forced by parents to attend 
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Too few children could be accepted 
Money spent for the counselor was unnecessary 
Summer Title I students were "picked on" by 
the Fall teachers ("Well, maybe they let 
you do that last summer, but In n\y class...") 
Negative attitude on the part of the school 
committee 

Parents withdrawing their children from the 
project 

Spontaneous enrollment of students Into a class 
with no notice to teachers so that plans 
could be made 

Students became attached to the Title I class and 
did not want to leave 

Children were defensive about being In Title I 
classes 

As for unanticipated positive outcomes, 11 out of 27 pro- 
jects for which data were available recorded no unexpected out- 
comes. Other mentioned were as follows: 

Change of attitude for the better 

General success of the pupil (not just reading) 

Full acceptance of teachers and administrators of 
the program 

Significant change In the child's attitude toward 
the school 

Overwhelming positive response of parents 
High morale of Title I staff 
Improvement of community attitude towards the 
program 

Positive responses of children 
Teachers realizing for the first time new aspects 
of the needs of children 
The contribution of having breakfast to the suc- 
cess of the program 



ERIC 



222 



Fewer pupils actually failing a grade 

Although our data- are meagre as to whether or not the 
unanticipated positive and negative outcomes were included 
in the evaluation report, we would judge that in general 
they were not, particularly in the case of the negative out- 
comes. 

20. WAS THE EVALUATION PROCESS ITSELF EVALUATED? 

Obviously a poor evaluation procedure or de- 
sign will not yield the kinds of results which 
will enable a project director to modify his pro- 
gram with the aim of improving it in any sensible 
and systomatic way. It is therefore necessary to 
evaluate the evaluation procedures in a given pro- 
ject so that evaluation itself might be improved. 
Inquiry was made as to whether or not project di- 
rectors considered the evaluation procedures to 
have been successful or unsuccessful based on their 
experience. 

In 6 out of 28 projects for which data were available, the 
director indicated that he had not evaluated the evaluation, 
six felt that there were no successful procedures adopted, and 
the rest simply expressed preference for some basic approach to 
evaluation. Generally speaking, our responses indicate a lack 
of expertise in evaluation and therefore a limited capacity to 
make judgments about evaluation procedures. 
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21. WAS ANY ATTEMPT MADE TO CARRY OUT A COST ACCOUNT- 
ING ANALYSIS OF THE PROJECT? 

An evaluation is not complete if it does not 
include information that will enable a judgment to 
be made as to whether or not the cost of the pro- 
ject is reasonable in light of what it accomplished. 

Responses were obtained from 25 projects out of the 43. 

In most of the projects, budgets were primarily allocated for 
salaries. In the smaller projects money tended to go mostly 
for materials and for the support of one or two teachers or 
aides. Three projects were reported to have budgets which 
were not in keeping with their priorities, although it was not 
clear what the priorities were. 

While it was usually the case that the project director 
could give a very accurate accounting of how the money was 
spent, in no case did we find evidence of a sophisticated cost 
accounting system, where cost was related to priorities assigned 
to various project activities. 

RECOMMENDATIONS 

It is a common experience for administrators to require reports 
of various kinds which are never read or used. Evaluation reports 
are no exception and our data show that for the most part the basic 
purposes of evaluation reports (mofidication towards improvement^ 
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"Evaluation studies are made to provide a basis for making 
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are frustrated by: 




The design of the report forms; 

The medium of the report; 

The pattern of dissemination; and. 

The timing and frequency of dissemination. 



Rather than being a vehicle for change, evaluation repor'ts are 
also frequently viewed as an official opportunity to justify what 
has been done by presenting the program In the most positive light 
possible. This attitude alvtays has an effect on dissemination 
P«terns and reduces Its utility considerably. We believe the fol- 
lowlhg recommendations are essential to the realization of the 
purposes of evaluation: 



(20) THAT THE STATE DEPARTMENT TITLE I OFFICE CREATE AND 
ADOPT A NEW EVALUATION REPORTING SYSTEM, GIVING ATTEN- 
TION TO THE USE OF NEW REPORT FORMS, DIFFERENT MEDIA 
D IFFERENT AUDIENCES,^ PATTERNS OF DISSEMINATION,^ 



For a useful d1sni«c?nn «« himself to the question of utility." 

research, see John HemphllTs chapter*on°"^^^ 

gram. ^ ^ Included In planning the changes In the pro- 
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AND FREQUENCY AND TIMING OF DISSEMINATION,^ ALL 
GEARED TO FACILITATE PROGRAM MODIFICATION FOR IM- 
PROVEMENT. SPECIFICALLY, EVALUATION REPORTS COM- 
ING AT THE END OF A PROJECT SHOULD BE REQUIRED TO 
INCLUDE CONCRETE RECOMMENDATIONS FOR PROGRAM MODI- 
FICATION, OR PRESENT EVIDENCE AS TO WHY THE PRO- 
GRAM SHOULD NOT BE MODIFIED WHEN REPEATED. 

(21) THAT EVALUATION RESULTS OF A PREVIOUS YEAR'S PRO- 
GRAM BE MADE A MANDATORY SOURCE OF INPUT FOR THE 
CURRENT YEAR'S PLANNING. PROPOSALS SHOULD THERE- 
FORE REQUIRE SOME KIND OF EVIDENCE CONFIRMING COM- 
PLIANCE. 

(22) THAT THE STATE DEPARTMENT TITLE I OFFICE PROVIDE 
TITLE I PROJECT PLANNERS WITH GUIDELINES FOR SETTING 
UP MODIFICATION PROCEDURES IN RESPONSE TO AN ON- 
GOING FEEDBACK PROCESS MAINTAINED AS A T^CHING 
STAFF AND ADMINISTRATIVE RESPONSIBILITY.^ 



^ Most project personnel regarded evaluation as a year-end 
or end -of- prog ram activity rather than as a process of analyzing 
continual feedback and then making decisions about alternative 
ways to improve the program while the program is still going on. 
Both kinds are needed. The latter has many implications for the 
timing and frequency of reporting. 

^ Some writers make a useful distinction between feedback 
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(23) that projects BE ENCOURAGED TO INCREASE COMMUNICA- 
TION BETWEEN TITLE I AND NON-TITLE I PERSONNEL IN RE- 
GARD TO SPECIFIC TITLE I CHILDREN SO THAT BETTER CON- 
TINUITY OF PROGRAMMING CAN BE MAINTAINED. 

A substantial portion of educational prograimlng In the pub- 
lic school system goes unevaluated. Yet there Is no good reason 
why It, too, should not be evaluated. If It were. It could help 
to provide useful perspectives on Title I programs, while at the 
same time supplying the means for Its change and Improvement. For 
this reason we recommend: 



and appraisal. "The purpose of the feedback Is to enable the tea- 
cher to make wise judgments about what to do next In the classroom; 
the purpose of the appraisal Is to describe some state of need, 
readiness, or ability on the part of the child. These purposes 
are entirely different and therefore the fact that they are achieved 
through different procedures seems reasonable. These differences 
may be noted: (a) In feedback, the decision about what data to 
collect can be finally made only at the moment of collection, where- 
as, In appraisal, the decision can be made Independently of the situ- 
ation. (b) In feedback, the object under scrutiny Is the activity 
of a complex system, whereas. In appraisal. It Is an aspect of the 
personality structure of an Individual, (c) In feedback, the cate- 
gories must be useful to the teacher and usually will be expressed in 
her vocabulary, whereas. In appraisal, the categories should fit co- 
herent theory and are often Intelligible only to the researcher or 
some other non- part id pant." See Herbert A. Thelen, "The Evaluation 
of Group Instruction," In Educational Evaluation: New Roles. New Means . 
National Society for the Study of Education Yearbook, LXVIII, Part II, 
1969, p. 119. 



(24) THAT EVALUATION REPORTS BE DISSEMINATED TO THE REGU- 
LAR SCHOOL SYSTEM'S PERSONNEL AS WELL AS TO ALL MEM- 
BERS OF THE PROJECT STAFF SO THAT ADOPTION OF EFFEC- 
TIVE TITLE I METHODS AND MATERIALS MAY BE ENCOURAGED 
IN THE REGULAR SYSTEM;^ and, 

(25) THAT THE STATE DEPARTMENT OF EDUCATION BEGIN TO EN- 
COURAGE SCHOOL DISTRICTS TO EVALUATE THEIR REGULAR 
PROGRAMS, DRAWING ON THE EXPERIENCE OF TITLE I PERSON- 
NEL. 

In the 1968 report on Title 1 compiled by the Title I Office 

of the State Department, a note was made that there was no way to 

"draw conclusions about the relationships between project cost and 

2 

project effectiveness." Yet this is an important part of evalu- 
ation and cannot be ignored. We therefore recommend: 



"Title I is designed to benefit poor children. Somewhat para- 
doxically, however, the programs made possible by Title I are seri- 
ously challenging traditional educational practices and introducing 
new techniques that promise to benefit fortunate children as well. 

In time, the major reforms now underway in low-income schools may be- 
come accepted priorities for all schools." Title I/Year II . The 
Second Annual Report of Title I of the E.S.E.A. 1965, U. S. Office of 
Education, 1968, p. 3. For more specific details, see whole section 
on "Catalyst for Change" from which above quote is taken. 

2 

Massachusetts Evaluation Report on E.S.E.A. Title I Activities 
Bureau of Elementary and Secondary Education, State Department of Edu 
cation, December, 1968, p. 29. 
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(26) THAT THE STATE DEPARTMENT GIVE SOME CONSIDERATION TO 
COST-EFFECTIVENESS^ AND TO LONG-RANGE PLANNING IN- 
VOLVING THE DEVELOPMENT OF ACCOUNTING SYSTEMS FOR 
TITLE I PROJECTS IN ACCORDANCE WITH NEW METHODS OF 
PROGRAM BUDGETING. 



analyses. . .are designed to measure the ex- 

resources allocated to a specific objective under 

ShfJ oj several alternatives actually contribute to accomplishing 

that objective, so that different ways of gaining the objective 

may be compared." See pp. 37-38, Budgeting for National O bilrtivpc 

Policy by the Research and Policy Committee* * 
for Economic Development, January, 1966. i^omnniiee 

inn +A exposition on the application of program budget- 

ing to the field of education planning, see Hartley, Harry J Edu- 

PrVam iiilng. Budgeting . Englewood Cliffs: PTct- 

3 * • .* 

- c listing four imperatives for schools today, the Committee 
for Economic Development included one on cost-effectiveness* 

systems must employ continuously the results of cost-bene- 
fit and cost-effectiyeness analyses in order to allocate effective- 
ly the resources available to education and to distinguish among pro- 

S? exploration by school administrators 

* ^ 2" f program accounting techniques in order to iden- 
Th! ’U nJ*°°^ systems and to take advantage of cost compari- 
sons. The adoption of such techniques by school districts will be 
advanced greatly if assistance and leadership in this area are pre- 

vided by state departments of education and by university schools of 
business, economics, and education." university scnoois of 

r ■ 1 Education; New Directions for the American School. 
Commi ttee for Economic Development, New York, July, 1968, p. 19. 




229 



PART II 



QUESTIONS AND OBSERVATIONS ON VARIABLES 
IMPORTANT TO COMPENSATORY EDUCATION 

Since evaluation refers to the process of determining how 
well project objectives are being achieved, it is possible for a 
project to appear highly successful, even though the objectives 
being achieved are inappropriate or irrelevant to the main pur- 
pose of compensatory education. It is therefore essential to con- 
sider the appropriateness of objectives and the degree to which 
these objectives reflect an awareness of research findings rele- 
vant to compensatory education. Thus, the observations and ques- 
tions of this part were designed to glean information from pro- 
jects pertinent to variables which research has demonstrated to be 
critical to the success of compensatory education programs. 

STAFF CHARACTERISTICS. SELECTION. RECRUITMENT 

i. CHARACTERISTICS OF PROJECT TEACHERS' AND ADMINISTRATORS, 

Information was collected on amount and kind of 
prior experience of staff members, particularly in re- 
lationship to the present assignment of 'the Title I 
staff, length of time with the system, whether or not 
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staff members volunteered or were assigned to their 
positions, and the amount of time that was allocated 
for assignments. Of particular concern here was 
whether or not the responsibility of the direction 
of the project was an added duty to an already full 
load or a partial or new full-time position, 

A large majority of the Title I teachers had previous 
teaching experience. Only 10% of the projects out of the sam- 
ple from which data were available (3 out of 29) had teachers 
with no teaching experience prior to their Title I assignment. 
There were no reliable data from which to compute the average 
number of years of teaching experience of Title I teachers. 

(Our impression is that it is somewhere between 9 and 15 years.) 

With regard to significant background in relationship to 
assignment, staff from 26% of the projects for which data were 
available (39) had teaching experiences, though no specific 
training congruent with their Title I assignments. Thirteen per- 
cent of the projects reported that they had staff members with 
some special training relative to their assignment while 20% 
reported no special training. About 85% of the projects reported 
having staff which volunteered for the Title I position. 

About 1/2 of the directors from projects in the sample for 
which data were available (36 out of 43) were serving in that 
position as an added duty. These people were usually administra- 
tive personnel. Only 6 projects reported that the directorship 




was a new position. In the smaller projactS} It Is consldarad 
Impractical to have a full-time or even part-time project di- 
rector who has release time from his regular duties. On the 
other hand, in many of the projects, administration would be 
far more effective if directors were either full-time or had 
an appropriate amount of release time to carry out their admini- 
strative responsibilities to the project. 

2. SUPPORTING STAFF. 

If the project employed support staff, such as 
teacher aides and/or other para-professionals , infor- 
mation on their backgrounds, duties, training, and 
the way in which they were utilized was gathered. 

Fifteen out of 37 projects for which data were available 
reported no systematic use of support personnel. Outside of 
teacher aides, personnel associated with psychological ser- 
vices and guidance, and/or health services emerged as the domi- 
nant support service used systematically. 

Forty- two percent of the projects reported teacher aides 
and/or other para -professionals as part of the support staff. 
Mothers or housewives and college students appear to be the 
primary sources of aides. Forty-four percent of the projects 
who had teacher aides reported that their primary duties were 
clerical in nature; 22% of the projects listed housekeeping 
type activities; and, 76% noted that the aides were assigned to 



assisting them with Instruction. Of the 18 projects re~ 
porting, only 7 provided them with any kind of training for 
their Title I assignment. 

In the Commonwealth of Massachusetts, a teacher aide 
Is not permitted to function In an Instructional capacity.^ 
It Is probably for this reason that there Is not a very ex- 
tensive use of teacher aides throughout Title I projects 
when compared to their rather exentlsve use In other states. 



Chapter 164 of the Acts of 1965 rules that an Instruction- 
al or administrative aide (as used In Section 38 of Chapter 71, 
which It amends) "shall be a person who does no actual teach- 
ing, but acts as an assistant to a teacher." 

2 

Fifty-two percent of the billion dollars provided by Title 
I was spent on Instruction during Its first year. Part of this 
went Into the creation of 180,000 new part-time and full-time pro- 
fessional and sub-professional positions other than teaching. 
Forty-eight of the fifty-four reporting agencies (state) told of 
turning to salaried sub-professionals. The First Year of Title I 
E.S.E.A. 1965 , U. S. Office of Education (6 po 1967-0-257-037), 

1967, p. V and p. 9. 

3 

"Assignments for aides varied widely. Most frequently, 
aides helped prepare materials, worked with Individual students 
and small groups, supervised class work and group games, corrected 
papers and performed clerical duties. Many school districts also 
employed aides to work with reading specialists, community workers, 
nurses, counselors, librarians, and other specialized personnel. 
During 1966-67, there were 83,500 teacher aides and 6,100 library 
aides working in Title I Programs." In 1966-67, California alone 
hired 4,300 aides for Title I programs. Title I/Year II, U. S. Of- 
fice of Education (GPO: 1968 0-312-658), 1968, p. 45. 





This may account for the reason why there is little train- 
ing offered to the teacher aides which were hired. Obvious- 
ly* ft takes very little training to perform housekeeping 
type duties and simple clerical tasks. However, It should 
be noted that aides are performing In an Instructional ca- 
pacity and should have training. 



3. STAFF CHARACTERISTICS RELATED TO ABILITY TO ESTAB- 
LISH RAPPORT WITH STUDENTS. 

Research In this area hss irudic&ted the impoT— 
tance of the capacity of a teacher to establish 
rapport with disadvantaged youngsters if they are 
to learn with any degree of efficiency. We there- 
fore gathered information on the teacher's atti- 
tude toward the disadvantaged child's learning abil- 
ity, the Title l project, the school in general, 
his/her own assessment of capacity in the project, 
and on the characteristics of the expectations of 
teachers with regard to pupil performance. In addi- 
tion, we were interested to see to what extent Title 
I projects serving different racial or ethnic groups 
made efforts to provide teachers, aides, or admini- 
strators of the project from the same ethnic group 
as the majority of the children and whether or not 
Title I staff members lived in areas similar to those 
of the students whom they were teaching. 

Almost 1/2 of the projects In the sample reported that the 
question concerning the extent to which Title I staff members 
reflect the same racial or ethnic group as the student body as 
Inapplicable. In many of the localities, particularly In the 




smaller communities ^ there is such a homogeneous population 
that no ethnic minorities are recognized. Only two of the 
projects out of the 40 projects from which data were avail- 
able indicated that a definite effort was being made. As to 
whether or not project staff members were living in areas 
similar to those of the students whom they were teaching, 
many projects reported that this was the case only because 
the town was small and homogeneous in nature. In larger com- 
munities, the employment of teacher aides greatly increased 
the chance of staff members living in the project area. 

In only 3 % of the projects for which data were available 
(36) did teacher attitude toward disadvantaged children's 
learning ability seem to be a serious barrier to pupil pro- 
gress.^ In 14% of the projects observers felt this to be a 
problem to a certain degree, while in 83% of the projects this 
was not considered to be a problem at all. Sixty percent of 
the projects from which data were available (38) had not taken 
into consideration the fact that expectations of teachers with 
regard to pupil performance has a definitive effect upon per- 

^ "Project SEAR, a report on the impact of compensatory educa 
tion on some poverty districts in California, discovered that the 
poor attitudes and prejudices displayed by some teachers toward 
their students hampered student achievement. The teachers did not 
understand the problems facing their students, and the lack of com 
munication resulted, in part, in the failure of the schools to in- 
fluence the pupils." Title I/Year II, U. S. Office of Education. 
1968, p. 43. 



formance levels J Over Zl% of the projects felt that this 
had been taken into consideration. This was one of the major 
reasons given for having selected the "best" teachers. 

On examining the prevailing attitude of Title I teachers 
toward the Title I project, towards disadvantaged children, 
the school in general, and his or her own capabilities as a 
staff member of the project, the response was, generally 
speaking, extremely positive. Only 5% of the projects from 
which data were available (38) indicated the presence of 
some definitely negative attitudes about the project. Even 
fewer projects reflected a negative attitude towards disad- 
vantaged children. Seventeen percent had some misgivings about 
the school in general, and no staff member felt negative about 
his own capabilities in the project, although some 22% of the 
responses to this question were "noncommittal." 



May I suggest to you that such attitudes (negative attitude- 
in regard to giving tests) are particularly harmful with respect to 
children from culturally disadvantaged backgrounds and may well jeoi 
ardize the validity of their test results... These pupils need to 
feel that in giving tests the teacher is deeply concerned about how 
well they do, that she wants to have them do their best, that she 
wants the test information only so that she can help them." Lennon, 
Testing and the Culturally Disadvantaged Child , pamphlet 
published by the Test Department of Harcourt, Brace, and World, Inc. 
19d 4, p. 12. 



4. ATTITUDE OF NON-TITLE I PERSONNEL TOWARD THE PROJECT. 

In some Title I programs, a cleavage between non- 
Title I personnel and Title I staff puts the Title I 
child into a position where he bears the brunt of 
staff disunity. We were therefore interested in find- 
ing out the prevailing attitudes of non-Title I per- 
sonnel towards the project. 

The prevailing attitudes of non-Title I personnel towards 
the Title I project were extremely positive. We collected no 
negative responses. Twenty- two percent of the projects gener- 
ated responses which could be categorized as "noncommittal" in 
nature. There tended to be relatively few responses from the 
personnel of summer projects since non-Title I personnel were 
not available to express their feelings about compensatory edu- 
cation. 

In summary, our experience in the field indicates that, 
for the most part. Title I project staffs are comprised of de- 
voted educators who have a very positive attitude about the 
work they are doing. 

RECOMMENDATIONS 

If programming is to be effective, objectives must be matched 
by resources adequate to carry them out. If resources are scarce 
or limited, it is more worthwhile to pick one single objective of 
high priority and allocate all available resources to achieve it 
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than to spread resources so thinly that nothing is accomplished. 
Our data indicate that insufficient attention has been given to 
this problem. We therefore recommend: 

( 27 ) THAT WHEN PROPOSALS ARE REVIEWED MORE ATTENTION BE 
GIVEN TO THE RELATIONSHIP BETWEEN PROGRAM OBJECTIVES 
AND STAFFING PAHERNS WITH PARTICULAR REFERENCE TO 
THE NEED FOR FULL-TIME PROGRAM DIRECTORS AND/OR 
REALISTIC AMOUNTS OF RELEASE TIME, BOTH FOR PLANNING 
AND IMPLEMENTATION, PARTICULARLY IN THE CASE OF 
LARGER PROJECTS. 

During the last few years some effort to determine the effec- 
tiveness of teacher aides has been made. The Bank Street College 
of Education study identified multiple benefits.^ Our data indi- 
cate that we are deprived of some of those benefits because of 



10 to J ^ 2 ^ Education study identifies some 

Most°of^t^S having teacher aides on the staff, 

^st of them are related to a more effective distribution of re- 

® efficient utilization of time. Other iSpoKan 

w^th the capacity of the aide, par- 
ticularly if he lives in the same area and/or shares a similar 

^^5 students with whom he works, to function as a 
positive role model for the students and to help interpret cross- 
culturally attitudes and behavior both from teacher to pupil and 
vice versa. Bowman, Garda W., and Klopf, Gordon J., Auxiliary 

and InstitutToHiTTzl^^ 

Bank street College of Education, October, IdGG, pp. 4-5. — 
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legal restrictions placed on the functions of aides. (See foot- 
note 1, page 210.) We therefore recommend: 

(28) THAT THE STATE DEPARTMENT OF EDUCATION CONSIDER THE 
FORMULATION AND INTRODUCTION OF LEGISLATION WHICH 
WOULD EXTEND THE FUNCTIONS OF A TEACHER AIDE SO THAT 
THESE KINDS OF SUPPORT PERSONNEL CAN BE MORE EFFEC- 
TIVELY USED IN HELPING THE TEACHER TO MANAGE THE 
TEACHING/LEARNING PROCESS. THESE EXTENDED FUNCTIONS 
SHOULD CERTAINLY INCLUDE, BUT NOT BE LIMITED TO, 

READING TO THE CHILDREN, LISTENING TO THEM READ AND 
CORRECTING THEIR MISTAKES, AND ASSISTING STUDENTS 
GENERALLY IN WORKING WITH ANY KIND OF PROBLEM, ALL 
UNDER THE DIRECT SUPERVISION OF THE TEACHER TO WHOM 
THE AIDE IS ASSIGNED.^ 

Because significant emotional support from staff and atti- 
tudes reflective of positive expectations are so critical to the 
performance of disadvantaged children, having those kinds of 
attitudes and the capacity to give that kind of support should 
be an important selection criterion for Title I staff. Although 

^ Several states, such as Illinois, Michigan, Colorado, and 
California have more functional definitions of the permissible roles 
of teacher aides which might be examined as possible models. 
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our data do not reveal a critical problem in this area, it still 
needs to be emphasized and we therefore recommend: 

(29) THAT THE STATE DEPARTMENT TITLE I OFFICE FIND WAYS 
OF ENCOURAGING PROJECT ADMINISTRATORS TO HIRE MINOR- 
ITY GROUP MEMBERS FOR TITLE I PROJECTS, PARTICULARLY 
IN THE CASE OF PROGRAMS SERVING POPULATIONS WHICH 
INCLUDE SUCH MINORITY GROUPS AND TO GIVE SERIOUS CON- 
SIDERATION TO AHITUDES TOWARDS THE DISADVANTAGED ON 
THE PART OF ALL APPLICANTS J 

G. PRE-SERVICE AND IN-SERVICE TRAINING 

5 . DESCRIPTION OF TRAINING OF TITLE I STAFF, 

Both pre-service and in-service training of 
Title I personnel were considered. Specific note 
was taken as to vdiether or not teachers had had 
training which included role playing, microteaching, 
strength training, and utilization of games in 
teaching , Information was also, gathered on how 
long the pre— service and in-service training was 
and who was in charge of it. 



ru.ij Teachers expectations are like self-fulfilling prophecies. 
Children will achieve what is expected of them. This was borne out 
by a study made in San Francisco by Prof. Robert Rosenthal of Har- 
vard University. He told teachers that certain of their pupils had 
a high learning potential, even though some did not. The result 
was higher teacher expectation and higher pupil achievement at the 

end of the school year." Title I/Year II . u. S. Office of Education, 
1968, p. 44. 



240 



Slightly under 1/2 of the projects from which data were 
available (36) had no pre-service training. A little over 
20% of the projects indicated that their pre-service train- 
ing involved more than a one-day effort, while 31% of the 
projects reported that their pre-service program was largely 
geared to orientation towards materials and machines and 
lasted only one meeting. 

Over 50% of the projects for which data were available 
(36) reported no in-service program. The nwst frequent in- 
service activity mentioned was a combination of unscheduled 
and scheduled meetings which turned out to be administrative 
in nature most of the time. Only 22% of the projects felt 
that they had an actual in-service activity that could really 
be called in-service training. None of the training activi- 
ties included experience with microteaching, strength train- 
ing designed to equip teachers to capitalize on their strengths 
and develop characteristics of patience, stamina, and endur- 
ance, etc., and experience in how to utilize games as a means 
of enhancing learning. 

Only two projects out of the sample used role playing as 
a training device. 




RECOMMENDATIONS 



According to a 1967 Yeshiva University report to the Civil 
Rights Conmissiont only 3% of the 15)000 teachers graduating in 
1966 from the ten major institutions that certify public school 
teachers had received any orientation in teaching disadvantaged 
children^ Yet, it is estimated that AO% of the children in the 
nation's schools require compensatory education. This general 
lack of preparation for teaching the disadvantaged is reflected 
in our data from the sample. This makes pre-service and in-ser- 
vice training all the more important. We therefore recownend: 

(30) THAT SCHOOL DISTRICTS BE REQUIRED TO PROVIDE EVIDENCE 
IN THEIR PROPOSALS THAT STAFF MEMBERS HAVE THE EXPERI- 
ENCE NECESSARY TO TEACH IN TITLE I PROGRAMS IN TERMS 
OF THE OBJECTIVES AND REQUIREMENTS OF THE PROJECT AND/ 
OR THAT ADEQUATE PROVISION IS MADE FOR PRE- AND IN- 
SERVICE TRAINING; 

(31) THAT IN THE CASE OF PROJECTS UTILIZING TEACHER AIDES, 
THEY RECEIVE TRAINING SPECIFIC TO THE ROLES THEY ARE 
EXPECTED TO PERFORM, AND THAT TEACHERS BE TRAINED IN 
HOW TO SUPERVISE AND WORK WITH AIDES;^ 



Reported in Title I/Year II . U. S. Office of Education, 1968, 

2 

The Bank Street College of Education study on auxiliary per- 
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(32) THAT STUDY OF THE EVALUATION OF THE PREVIOUS YEAR'S 
PROGRAM BE MADE A REGULAR PART OF THE PRE-SERVICE 
TRAINING OF STAFF MEMBERS OF ANY CURRENT YEAR; AND, 

(33) THAT PRE-SERVICE TRAINING INCLUDE DEVELOPING A THOR- 
OUGH KNOWLEDGE OF THE EVALUATION ASPECTS OF THE PRO- 
JECT AND THE SPECIFIC OBJECTIVES OF THE PROGRAM IN 
TERMS OF BEHAVIORAL OUTCOMES. 

Data collected in response to items listed under Learning 
How to Learn and Motivational Aspects of the Program indicate 
that pre-service and in-service training activities did not in- 
clude a number of very important itemj which are discussed in 
those sections. Because of their relevance to pre-service and 
in-service training, additional recommendations concerning train- 
ing of compensatory education personnel are presented at the end 
of Part II. 



sonnel found role definition and role development for aides to be 

„ ■ . . .* . ■ success of programs using aides. Furthe- 

more, training of aides specific to the tasks their roles will re- 
quire were likewise found to be extremely important. 



Bowman, Garda W. , and Klopf, Gordon J., Auxiliary School Per- 

' • Their Roles, Training, and Institutionalizatio n. Rank 

Street College of Education, October, 1966, pp. 6-7. 
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LEARNING HOW TO LEARN-DEVELOPING EFFECTIVE LEARNERS 



6 . TEACHING THE PROCESS OF LEARNING, 

The ess6ntiel feature of a good compensatory 
education program is adequate provision for means 
that will enable disadvantaged' youngsters to be- 
came permemently effective learners. This in- 
volves learning something about how to learn it- 
self. We were therefore interested in ascertain- 
ing whether or not compensatory education programs 
actually taught or offered experiences which 
would increase the competence of the learner by 
enabling him to understand something about the 
nature of knowledge and recall^ techniques for 
comprehension and transferability of knowledge ^ 
how to apply principles, how to analyze and syn- 
thesize Liaterial, how to perform evaluations of 
materials , and convergent and divergent thinking. 

While most of the projects in the sample reflected or 
involved some of the above listed learning processes, no pro- 
ject placed a major emphasis on learning how to learn as 
such. Virtually all of the projects, both summer and winter, 
placed an emphasis on recall or memory, that is, students 
were expected to store and retrieve specific information. 
However, there is a difference between expecting somebody to 
remember something and teaching actual ways of increasing the 
quality of memory and presenting materials in a way which fa- 
cilitates recall. Projects emphasize the former but neglect 
the latter. About 75* of the projects from which data were 




available (28) emphasized comprehension as a requirement on the 
part of the student. Here again, there was no focus on the 
capacity of comprehension as such and how to develop that ca- 
pacity. The same situation was true of all of the remaining 
Items. Around 50% of the projects emphasized application, about 
1/3 were concerned with analysis and synthesis, approximately 
25 % were concerned with evaluation, and less than 1/5 did any- 
thing with convergent and divergent thinking In any definitive 
sense. (See Appendix VI, page 325, for tabulation.) 

7 . GENERAL SKILLS AND CAPACITIES RELATED TO LEARNING, . 

Attempts were made to identify any part of a 
given project which focused on the development of 
any of the following capacities: listening, ob- 

serving, recording information, attending behavior 
and increasing attention span, test taking, follow- 
ing directions, effective work and study habits, 
visual discrimination, vocabulary and word reason- 
ing, speech, information seeking behavior (how to 
ask questions and where to find information) , prob- 
lem solving, and participation in a group as a mem- 
ber, All of the above capacities are known to con-- 
tribute to efficiency in learning and therefore 
should be a part of every well-developed compensatory 
education program. 

Of the above listed capacities or skills, listening, ob- 
serving, following directions, vocabulary and word reasoning, 
and speech were considered by over 50% of the projects from 
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which data were available (33) as being most important. Prob- 
lem solving, participation in social groups, and information 
seeking behavior were considered least important. Approximate- 
ly 25 % of the projects considered recording, attending behavior, 
test taking behavior, study habits, and visual discrimination 
as important. (See Appendix VI, page 326, for complete tabula- 
tion. ) 

RECOMMENDATION 

During the first four or five years of their lives, most 
middle-class children go through a "hidden" curriculum which pro- 
vides for them the kinds of basic learning competencies that are 
prerequisite to successful performance in school.^ Up to the pres- 
ent time, schools have based their curricula, their teaching me- 
thodology, and their grading and incentive systems upon the erron- 
eous assumption that everyone coming into the school has had ex- 
posure to that "hidden" curriculum and mastered it reasonably well. 

^ See, for instance, Basil Bernstein's research on how langu- 
age, as learned while growing up in the home, structures and condi- 
tions what the child learns and how he learns and particularly how 
this can set limits within which future learning may take place. 

Bernstein, Basil, "Social Class and Linguistic Development: 

A Theory of Social Learning," in Education. Economy, and Society , 
edited by A. H. Halsey, et.al . . Glenco, Illinois: Free Press, 1961. 
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A child growing up in poverty or semi -poverty will also be ex- 
posed to a "curriculum"— one that enables him to survive in his 
culture, to be sure, but also one that does not provide him with 
the kinds of learning competencies prerequisite for successful 
performance in schools as they are currently set up. 

In coming to the school situation, he is clearly at a tre- 
mendous disadvantage when compared to his more affluent peers. 

The school then compounds the disadvantage by giving him learn- 
ing tasks the prerequisites to which he has not yet mastered, 
thereby setting him up for a guaranteed failure. Being stuck in 
such an intolerable and unjust position and being forced to ac- 
cumulate failures over long periods of time generate such nega- 
tive emotional by-products, all associated with the formal learn- 
ing situation, that effective learning within the formal con- 
text becomes impossible. Since failure in school reduces oppor- 
tunities for attaining future economic security and continuing 
growth and development, both socially and personally, the magni- 
tude of this problem approaches incomprehensible dimensions. Its 
ramifications are far-flung largely because the situation perpetu- 
ates itself through a cycle that is difficult to interrupt. 

There are approximately 15 million children who find them- 
selves locked in a system that is not only not helping, but in 
many cases making things worse. Compensatory education emerged 
as the answer to the problem. This kind of education is supposed 
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to "compensate" for the missed "hidden" curriculum. The tendency 
has been to cast compensatory education Into a remedial mold or 
put It In the form of general enrichment activity. Both of these 
have their place* but If they do not focus on the task of develop- 
ing competent learners, they are apt to have very little permanent 
or even short-term effects.^ Our data Indicate that Title I pro- 
grams In Massachusetts are similar to the variety of compensatory 
education programs that do not focus on developing competent learn- 
ers and which are therefore not being maximally effective. 

therefore urge that the following recommendation be regarded as ur- 
gent and critical : 

(34) THAT THE STATE DEPARTMENT TITLE I OFFICE MAKE THE 
DEVELOPMENT OF EFFECTIVE AND COMPETENT LEARNFRS THF 
REQUIRED MAIN OBJECTIVE OF ALL TITLE I PROGRAMS AND 
THAT LOCAL PROJECTS BE GIVEN ASSISTANCE IN TRANSLATING 



critical look at Title I, see Robert Dentler's 
article. Urban Eyewash: A Review of 'Title I/Year 11'" In The 
Urban Review, vol. 3, no. 4, February, 1969, pp. 32-33. — 

2 

A study of 132 schools receiving Title I funds showed no Im- 
provement In achievement on the part of pupils, though again there 
were evaluation and data collection problems. See Mosbeck, E. J., 

» Analyses of Compensatory Education In Five School District s , 
* General Electric Company, Santa Barbara, California, March, 
1968. Report Is available through the U. S. Office of Education. 
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THIS MAIN OBJECTIVE INTO SPECIFIC BEHAVIORAL OBJECTIVES 
RELEVANT TO THEIR OWN PROGRAMS. 



Since the data discussed in this section have implications 
for pre-service and in-service training, establishing of pro- 
gram objectives and planning, additional recommendations rela- 
tive to the topic of this section appears at the end of Part II. 



I. MOTIVATIONAL ASPECTS OF THE PROGRAM 



8. INDIVIDUALIZED PRESCRIPTIONS FOR LEARNING, 

In order to avoid setting children up for fail- 
ure it is essential to know where they are and to 
make individualized prescriptions for learning con- 
sistent with their present status. We were there- 
fore interested in having information on whether or 
not such individualized prescriptions for learning 
were made, how they were made, whether or not there 
was an emphasis on the strengths or weaknesses of 
the pupils and whether or not consideration was given 
to the interests of students , 



Eighteen of the projects from which data were available 
(40) made efforts to individualize prescriptions for learning. 

A wide variety of ways for making such prescriptions were re- 
ported ranging from intuitive judgment and trial and error to 
the more formal means of diagnostic testing. Thirty-seven per- 
cent of the projects identified weaknesses and/or strengths of 
students so that the program could be geared to either or both. 




Again, the means whereby this was achieved varied from infor- 
mal intuitive judgments about weaknesses and strengths to more 
formal means of diagnostic testing. In certain cases the 
weaknesses were very evident, as in the case of a child who 
does not speak English or one who cannot read. For the most 
part, project personnel found it easier and/or more convenient 
to identify weaknesses and work with those rather than ascer- 
tain strengths and find ways of building on those strengths 
and relating them to areas of weakness in such a way that they 
might be overcome. 

Generally speaking, people prefer doing those things which 
they can do best and would prefer to avoid doing those things 
which they do not do well. There are, therefore, many more 
favorable implications in regard to building on strengths than 
dealing directly with weaknesses, though no doubt a combination 
of some kind is essential. When staff members who indicate 
that they used the approach of building on strengths were asked 
in what way they identifted strengths and how they built on them, 
explanations were vague and non-specific. 

Twenty-five percent of the projects felt that they had given 
special consideration to the interests of children in determining 
the bulk of the learning activities. Again, interest has many 
implications for motivation and since disadvantaged children often 
feel themselves to be unmotivated in formal learning situations. 



giving consideration to student interests has a great deal 
of importance. (See Appendix VI, page 327, for data sunmary.) 



9. BASIS FOR CURRICULUM PREPARATION. 

MO'tivs'tion h&s Jbeen found to be in pert dependent 
upon the relevance of curriculvaa materials from which 
students must learn. We were therefore interested to 
know whether or not and to what extent the curriculum 
for the program was planned to be consistent with stu- 
dents' environments, experiences, abilities, and inter- 
ests. We also looked for evidence of specific favor- 
able verbal and non-verbal reference to racial and cul- 
tural minority yroups within the materials and teach- 
ing techniques employed. 

Approximately 1/3 of the projects from which data were avail- 
able (34) felt that consideration had been given to planning the 
curriculum so that it would be consistent with the child's en- 
vironment. Specific explanations of how this was done were rare 
and most project personnel felt a little bit at a loss as to how 
it might be done. In essence, it is the matter of having teach- 
ers of compensatory education becoming familiar with the cultural 
world of the child and starting where he is rather than expecting 
the child to climb out of his cultural world and adjust on his own 
to the middle-class culture of the school. 

A little over 1/3 of the projects felt that the experiential 
background of students was considered when the curriculum was 
planned. Here again, concrete examples were not plentiful and 
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discussion with staff members revealed some difficulty in 
understanding how this might be done extensively. To be 
oertain^ this is not an easy guestion^ but on the other hand* 
if a specific learning task is given to a student without 
regard to how that task is consistent with his experiential 
background, the student may not have yet mastered the pre- 
requisites to that task and then will find himself set up 
for a guaranteed failure— the typical experience of the dis- 
advantaged youngster. Matching experiential backgrounds of 
children to learning tasks is critical in compensatory edu- 
cation. 

Seventy-two percent of the projects considered that abil- 
ities were taken into consideration when the curriculum was 
designed. Given the nature of Title I programs in general, 
one would expect this percentage to be as high or higher than 
it is. Over half of the projects reported that interests of 
children had been considered when planning the curriculum, al- 
though no indications were given as to how interests were in- 
ventoried. The major exception to this was during a few summer 
projects when some students actually had a say in determining 
what would be done during some components of the project. For 
instance, in a few projects where sports were clearly of great 
interest to students, they were allowed to determine what sports 
activity would be undertaken. In other cases, a wide variety 
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of activities was predetermined by the staff, but students 
were allowed to choose which ones of the ones available 
they would like to participate in. 

Children from minority backgrounds frequently have mo- 
tivational problems because there is little in the environ- 
ment or in the curriculum materials which confirms and sup- 
ports their identity as members of a minority group. Seventy- 
four percent of the projects from which data were available 
(31) lacked any significant favorable reference to ethnic 
minorities in their curriculum materials. Sixteen percent in- 
dicated some inclusion of favorable materials in books, par- 
ticularly in illustrations. Three percent of the projects 
used pictures on the wall depicting persons from different 
racial backgrounds, and around three percent employed teachers 
who were from minority backgrounds themselves. Approximate- 
ly actually taught courses which focused on the history 
or culture of an ethnic minority. In many cases the popula- 
tion being served by the Title I project was not multi-ethnic 
and so project staff members felt it unnecessary to be con- 
cerned about this issue. In a few cases, teachers actually 
expressed a desire to have students from a different minority 
group visit their classes. (See Appendix VI, pages 328-330, 
for data summaries.) 





10. PRESENTATION MODE UTILIZED IN INSTRUCTION. 

Since research evidence indicates that the 
folloHing presentation modes facilitate learning. 

He inquired as to whether or not projects made 
provision for them: 

Organization of material in short, sequential 
steps as needed; 

Continuous and immediate success experiences with 
immediate feedback being viewed as an important 
reinforcer; 

Adequate evaluation of where the child is at any 
given point and his readiness for the next step; 

Use of the "saturation approach" (repetition, sum^ 
mari ration, altemati 3 explanations, and the use of 
connecting links with different contexts) ; and 

Multi-media presentations. 

Eighteen out of 20 suniney projects from which data were 
available and 11 out of 12 winter projects from which data 
were available had evidence that In subjects where appropri* 
ate, material was broken down Into short, sequential steps In 
order to facilitate learning. Around 57* of the projects, both 
sunnier and winter, felt that they provided for continuous and 
Immediate success experiences at least In some aspect of the 
program. In many cases this approach was limited to a small 
portion of the time that the child was actually engaged In 
Title I activities. Of coune, certain kinds of subject matter 
lend themselves with greater facility to the provision of re- 






inforcing feedback at appropriate times. Forty- five percent 
of the projects evaluated the child after each step in order 
to deteimlne readiness for the next step In at least one or 
more aspects of the project. Thirty-seven percent of the 
projects used a saturation approach involving repetition, 
summarization, and alternative ways of explaining things at 
least during one or more aspects of the program. Though a 
fair percentage of the projects included one or more of the 
above presentation modes, nonetheless, observers reported that 
there was little extensive and syst<!matic use of them which, 
for the most part, have been demonstrated to be very effec- 
tive, if not essential, when working with disadvantaged young- 
sters. (See Appendix VI, page 32g, for tabulation.) 

11. HANDLING OF FROSTRATtON AND FAILURE. 

Many disadvantaged youngstexs have a back-" 
ground of failure tfhich figures strongly i.*? pres-" 
ent frustrations with learning. The distribution 
of rewards and punishments can have a direct ef- 
fect on reducing osr increasing frustration and 
failure. Inquiry was made as to tdtether or not 
projects had adopted a consistent policy concem- 
ing reward and punishment, whether or not the pro- 
ject capitalised on student interests as a means 
of fostering siotivation, and whether or not activi- 
ties were arranged so that childr&i could experi- 
ence a sense of mastery and achie veme nt (oospeten- 
cy motive tioi7) and conmylidata gains male in this 
direction by having the opportunity to apply what 
was learned. 
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Seventy- four percent of the projects from which u*?ita 
were available (33) indicated that efforts were made to 
capitalize on student interests as a means of counteracting 
patterns of frustration and failure, although specific wj^ys 
of ascertaining student interests were not formalized nor 
consistent. A conscious use of reward and punishment as a 
means of increasing motivation was employed by approximate- 
ly 55% of the projects. Here again, however, much of the 
application of the principles of reward and punishment was 
based on "common sense" and intuitive judgments rather than 
upon any knowledge based upon research findings. A third 
of the projects Indicated that efforts were made to Insure 
that children felt a mastery over what they were doing as a 
means of increasing what has been called "competence motiva- 
tion." For the most part, however, this was not incorporated 
into the program in any systematic way over long periods of 
time so that a child would receive a growing sense of mastery 
over a wide variety of subject matter areas or skill areas in 
a way in which he wjuld be conscious of it to the degree neces- 
sary to insure a competence motivation (See Appendix VI, page 
331, for tabulation.) 

12. se:lF“Zmage. 

__ X>urlng the last several yearsp self-image has 
emerged as a useful conceptaallzation of horn a person 
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regards himelf and hotf that self-regard in turn 
determines behavior • Since so many recent efforts 
in compensatory education have dealt with "improve- 
ment of self-image" as an objective of compensatory 
education, we gathered information on the extent to 
which projects made any attempt to analyse the self- 
concepts of children and whether or not there were 
specific aspects of the project which were planned 
as appropriate means for developing healthier self- 
concepts (such as systematic use of role models or 
systematic use of a variety of reinforc&aents fol- 
lowing achievement on any level ) . 

Out of 34 projects from which data were available, three 
sunmer projects and six winter projects made attempts to analyze 
student self-concepts. On the one hand, since Improvement 
of self-image was such a predominant objective, this Is diffi- 
cult to understand. On the other hand, since there are very 
few effective analytical tools for determining or measuring self- 
concept, It Is understandable that projects would hesitate to 
attempt such analysis. Eight sunmer projects and five winter 
projects Indicated that particular aspects of their programs were 
especially Important for Improving children's self-concepts. 

There were a wide range of responses as to what aspects these 
were, but most of them had to do with having learning experiences 
In which they did not feel "rejected" but In fact felt that they 
were accepted and that they experienced warm and supportive staff. 
Some project personnel felt that It was most Important for a child 
to develop an "I can" kind of attitude and that this would be the 
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best thing for the Improvement of self-image. However, 
observers noted little theoretical orientation to the 
subject of self-image and a lack of awareness of what re- 
search has been done In this area (though admittedly 
there remains much to be done). 

Less than 1/4 of the projects from which data were 
available (36) made any systematic or specific use of role 
models to assist students In learning. Where this was con- 
sidered, responses usually centered around the fact that 
teachers whom students admired and gravitated toward natur- 
ally were selected to be on the Title I staff because they 
were felt to be good teachers as well as good role models. 
One project actually Incorporated a number of normal achiev- 
ers to serve as role models. However. In no project was 
the Idea of using role models a deliberate or prominent fea- 
ture of any aspect of the program. (See Appendix VI, page 
332, for tabulation.) 

13, Z£VELS OF IttVOLVEMENT, 

It has been found that learning on the part 
of the disadvantaged can be greatly facilitated 
if they do not have to remain passive recipients 
itiforaiation but in fact can become involved 
•fra doing things. For this reason^ ve vox’s in— 
terested to ascertain whether or not projects sro— 
ployed means of involving youngsters and making 
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them more active participants in the learning 
process through games, dramatics, role playing, 
and use of peers as teachers. 

Twenty-nine percent of the projects from which data were 
available (37) used none of the above mentioned means of en- 
hancing learning. Sixty-four percent of the sunnier projects 
and 40% of the winter projects used various kinds of games; 

16% of both winter and summer projects used dramatics of some 
kind as a means of enhancing learning in at least one or more 
aspects of the program. Role playing, utilizing students as 
teachers of peers, and multi -media presentations were used in 
less than 15% of the projects, sunnier and winter taken together. 
(See Appendix VI, page 334, for tabulation.) 



14. SPECIAL INSTRUCTIONAL HATERIALS. 

The individualization of instruction can be 
facilitated by the use of a wide vsuriety of differ- 
ent instructional materials and equipment. Infor- 
mation was gathered as to the kinds of special 
instructional materials and equipment that was 
available, whether it was utilized or not, what 
was being locally developed, and whether or not 
project personnel had access to facilities for cre- 
ating overheads, film strips, still photos and 
slides, moving films, tape recordings, and video- 
tapes. 

Practically all of the projects used a wide variety of 
special materials. Over 92% of the projects from which data 
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were available (36) had special materials available and 
all but 3% of those used them regularly. Twenty-two 
percent of the projects had locally developed special 
Instructional materials. It Is Interesting to note that 
more sunnier projects than winter projects used special 
Instructional materials. Winter projects tended to have 
materials available and access to equipment; however, 
they appeared to be used less frequently than In summer 
projects. Sometimes the special materials and equipment 
used by the sunnier staff would tend to be stoi^d during 
the winter time when a different staff took over the win- 
ter project. Observers also noted that sometimes It was 
difficult for summer projects to locate project equipment 
used during a previous sunnier. Locally made Items Included 
slides, still photos, games, work sheets, films, and audio 
tapes. (For a fuTler tabulation, see Appendix VI, pages 
335-337.) 



15 . CIASS SIZE AND CHARACTERISTICS, 

A smaller class size can facilitate the in- 
dividualization of instruction. Therefore, we 
collected data on class size and pupil/ teacher 
ratio. We were also interested to see whether or 
not classes we e ethnically integrated since 
studies have shown that integration facilitates 
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learning on the part of minority groups, but 
does not dg>ress learning of the majority,^ 

There was a wide variety of arrangements made in 
regard to class size and teacher/pupil ratio. In some 
cases, for instance, a teacher aide or two would be added. 
In other cases, there would be small group activity in 
a corner of a room supervised by the teacher who was also 
directing another group in another corner of the room. 
Thus, the same project may use both very small and very 
large classes depending upon the activity or the need. 
There were cases noted, however, where lower ratios were 
not used effectively. Summer projects appeared to be far 
more flexible in regard to teacher/pupil ratios and class 
size than winter projects. 

In general, compensatory education classes reflected 
a consideration for the value of individualizing instruc- 
tion and therefore the need to have classes as small as 
might be possible. The average class size reported by 
most projects was between 10 and 13 students. (See Appen- 
dix VI, page 336, for detailed breakdown.) 



^ Coleman, James S., Equality of Educational Oyortunity 
(better known as The Coleman Report) U. S. Office of Education, 
1966. 
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RECOMMENDATIONS 



Individualization of instruction is one of the most basic 
responses to the need for disadvantaged children to achieve at 
a rate above the norm. Much of the Title I Instruction, particu- 
larly In the summer projects, reflected an acceptance of this 
principle. It was also evident that the State Department Title 
I Office had made efforts to hold the line on numbers of children 
being served so that teaching efforts could be Individualized 
as much as possible and not diluted to a point where the teach- 
ing approach could not take Individual pupil needs Into considera- 
tion. However, more encouragement for Improving the quality of 
Individualized Instruction Is needed. Few teachers have been 
trained to teach on this basis; yet, to be effective In the ap- 
proach, techniques different from those used In teaching larger 
classes must be employed. He therefore reconmend: 

(35) THAT AN INCREASED EMPHASIS BE PLACED ON THE INDIVIDU- 
ALIZATION OF INSTRUCTION, PARTICULARLY DURING THE WIN- 
TER PROJECTS, AND THAT INCLUDING INFORMATION AND PRAC- 
TICA ON HOW TO INDIVIDUALIZE INSTRUCTION BE ENCOURAGED 
AS PART OF PRE-SERVICE AND IN-SERVICE TRAINING OF 
TITLE I STAFF. 

The motivational and cognitive needs of disadvantaged young- 
sters have direct Implications for both curriculum development and 






teacher training J Our data show that the many considerations 
related to these needs (as discussed in Sections H and I) are 
familiar to most Title I personnel, but not thoroughly enough 
to be translated into curricular changes and teaching methods 
that are maximally effective. It is certain that the level of 
competence required to achieve the objectives of compensatory 
education cannot be attained through a few workshops and/or 
several hours of pre-service or in-service training.^ However, 
until long-term training programs are developed by universities^ 
(which have only begun to assume this critical responsibility) an 
improved short pre-service training will have to suffice.^ We 
suggest: 



^ See Ausubel, David P., "A Teaching Strategy for Culturally 
Deprived Pupils: Cognitive and Motivational Considerations," 
School Review . Winter, 1963. 

2 

The range of needs of disadvantaged children presents a 
challenge that is more complex and difficult than the needs most 
physicians encounter in their patients. Yet no one expects a 
physician to deal with his patients thirty at a time with only 
three days pre- service training. 

^ See the Section on Model Training Program for compensatory 
education personnel in the sunmary section. Blueprint for Action, 
page , for details on long-term training. 

^ A group of researchers at Arizona State University studied 
changes in attitudes of educators toward disadvantaged children 
before, during, and after special in-service training. Teachers 
who experienced the Title I training changed favorably toward 
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(36) THAT THE STATE DEPARTMENT TITLE I OFFICE, POSSIBLE 
IN COLLABORATION WITH PRIVATE OR PUBLIC INSTITU- 
TIONS CONCERNED WITH EDUCATION OF THE DISADVANTAGED, 
PROVIDE ASSISTANCE TO LOCAL PROJECTS IN DEVELOPING 
CURRICULA THAT ARE BASED ON STUDENT NEEDS, INTER- 
ESTS, AND EXPERIENTIAL BACKGROUND SO THAT MAXIMUM 
MOTIVATIONAL SUPPORTS ARE PRESENT WITHIN THE CURRICU- 
LUM; AND, 

(37) THAT PROJECT PLANNERS AND DIRECTORS BE ENCOURAGED TO 
CONSIDER THE MERITS OF THE VISUAL ARTS, MUSIC, DANCE, 
AND THEATRE ARTS AS A MEANS OF MAINTAINING HIGH LEVELS 
OF INTEREST AND MOTIVATION, FOSTERING COGNITIVE AND 
PERCEPTUAL GROWTH, AS WELL AS DEVELOPING AESTHETIC 
SENSITIVITY.^ 



these children while control group teachers maintained unfavor- 
able attitudes. This is positive evidence of the worth of train- 
ing geared to meet special needs. For more details, see Title 1/ 
Year II , Second Annual Report of Title I, U. S. Office of Educa- 
tion, 1968, p. 118. 

^ The Center for the Study of Aesthetics in Education at the 
University of Massachusetts, Amherst, is currently engaged in the 
development of a curriculum which is based on art experience and 
its relationship to cognitive and affective growth. The Title III 
(PACE) program at Attleboro, Massachusetts, directed by Mr. Donald 
Brigham, is an outstanding example of the way in which involvement 
in art activities can support motivation for learning at high levels. 
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Since relevance of materials is a supportive factor In 
sustaining motivation) children who belong to minority groups 
must be able to Identify with some aspects of the subculture 
from which they come as represented In curriculum materials. 
Given the diversity of the people comprising our society and 
our commitment to democracy, such representatloi Is also rele- 
vant to children who do not belong to a minority group. We 
therefore recommend: 

(38) THAT LOCAL PROJECTS BE ENCOURAGED TO INVEST IN 
READING AND VISUAL MATERIALS THAT MEANINGFULLY 
REPRESENT MINORITY GROUPS, WHETHER OR NOT THERE 
ARE MINORITY GROUP MEMBERS PRESENT IN THE PROJECTS 
OR ON PROJECT STAFFS. 

J- PARENTAL, HOME, AND COMMUNITY INVOLVEMENT 

16. PARENTAL SUPPORT. 

Studies have sh<Mn that significant individu- 
als in the lives of students, especially family 
members, have an important influence upon their 
learning in school. We were therefore interested 
in whether or not projects recognized the nature of 
this influence and whether or not they had a pro- 
gram designed to involve parents and, if so, the 
nature of this program. 

Of the 34 projects responding, 21 or 62% had not Identi- 
fied and recognized the Influence of significant Individuals 
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in the lives of Title I students. Of the 12 positive re- 
sponses, at least 7 referred to parents or family. One 
specifically mentioned identifying a non-family person 
and asked him to counsel with the student in question. 

Other projects were sensitive to problems in the lives of 
students who came from broken homes or who had one or no 
parents. However, no project in the sample from which data 
were available conceptualized a portion of its program on 
the importance of family members and their influence on 
academic performance of students. 

In over 1/2 of the projects from which data were avail- 
able (29) parents were not actively involved. We did not 
regard grafting permission for children to participate in 
the program as active involvement on the part of the parents. 

Three of the most frequently mentioned activities in- 
volving parents were: (1) general volunteer work within 
the project, (2) parents as teacher aides within the pro- 
ject, and (3) as field trip assistants. 

For the most part, parental involvement was minimal, 
and when it was present, it was not too imaginative. Given 
what is known at the present time about the importance of 
family and community involvement in the education of disad- 
vantaged children, this finding is disappointing. 

Services offered to parents seemed to be of the usual 
school type (PTO activities, parent-teacher conferences, etc.) 




which have proved unsuccessful with parents of disadvantaged 
youngsters — people who, in general, probably did not succeed 
in school themselves. Only one. project reported a service 
that offered counseling to parents and four projects mentioned 
home visits. In general, working with parents was a neglected, 
though potentially important part of most programs. 



17 . COMMUNITY SUPPORT. 

Since the progress of a child in school is in 
many cases also directly related to his connections 
with other parts of the comnunity in which he lives f 
we were interested to find out the nature and extent 
of community involvement in compensatory education 
programs. We inquired specifically as to whether 
or not any given program had a referral service where 
by theachers and/or other project staff, recognizing 
certain problems or deficiencies among students, 
could call upon other agencies for assistance (such 
as welfare agencies, charitable institutions who 
could provide clothing, clinics to provide medical 
attention, dental care, glasses, etc.). In this 
connection we were also interested to find out whe- 
ther or not any program made provision for maintain- 
ing adequate nutritional status of students 



Mt is noteworthy that the National Advisory Council on the 
Education of Disadvantaged Children still regard nutrition of Title 
I children as an unmet need, in spite of the fact that the largest 
expenditure of Title I "health" funds was for free lunches. See 
Title I E.S.E.A; A Review and a Forward Look - 1969, Fourth Annual 
Report of the Council, 1969, p. 46. 
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In response to an inquiry about the nature and extent of 
cotranunity involvement in the project, approximately 2/3 of the 
projects from which data were available (33) indicated no 
community involvement. Three projects mentioned involvement 
of the Community Action Agency. Local social agencies were 
mention?d by 6 of 19 projects responding positively. Their 
.basic function was to aid in recruitment and to make or 
accept referrals. Basically, this indicates only a peripheral 
involvement. Three projects mentioned utilization of volun- 
teers from within the community. 

Half of the projects had no reported referral service 
mechanism within their Title I project. Positive answers to 
the question on referral services were highly varied and in- 
cluded such items as: social workers, mental health agencies, 
high school counselors, testing by local agencies, language 
clinic, hospital, school nurse, medicare, and dental clinics. 
Observers reported that referral was a relatively rare and 
isolated occurrence and that extensive referrals as a systematic 
part of the program were unusual. 

As to whether or not projects drew on community agencies 
to help insure a sound nutritional status of students, most 
projects, particularly summer ones, provided snacks, milk, or 
juice. One project served breakfast while three served lunch 
and others provided lunch and snacks. In many cases, food and 





snacks were not provided from Title I funds. One project 
provided students with medical exams, but other than this 
there was no systematic effort to determine the precise 
nutritional status of students, nor an effort to decide what 
should be done in terms of food supplements or vitamin 
supplements. (See Appendix VI, page 340, for data summary.) 

RECOMMENDATIONS 

The American Institutes of Research in a study designed to 
identify features of a "successful" compensatory education pro- 
gram listed active parental involvement as one very important 
factor.^ Research has also demonstrated the influence of sig- 
nificant others, particularly parents, can have on school per- 
formance. Our data show a need to strengthen this aspect of 
Title I programs. The trend to increase parental and community 
involvement because of their promise for supporting educational 
objectives effectively is consistent with our recommendation: 

(39) THAT PROJECT PLANNERS BE ENCOURAGED TO INVOLVE PARENTS 
AND COMMUNITY IN TITLE I PROJECTS TO A MUCH GREATER 
DEGREE THAN PRESENTLY EXISTS AND THAT PROPOSALS BE RE- 
QUIRED TO SPECIFY THE NATURE OF INVOLVEMENT ON ALL 



Title I - E.S.E.A; A Review and a Forward Look - 1969 , 
Report of the National Advisory Council on the Education of Dis- 
advantaged Children, 1969, p. 23. 



LEVELS: PLANNING, IMPLEMENTATION, AND EVALUATION; 

(40) THAT SCHOOL DISTRICTS BE ENCOURAGED TO CONSIDER EDU- 
CATIONAL AND SOCIAL SERVICES FOR PARENTS AS PART OF 
THE TITLE I PROGRAM AND THAT SUCCESSFUL EFFORTS IN 
THIS AREA BE DISSEMINATED TO OTHER PROJECTS; AND, 

(41) THAT PROJECT DIRECTORS BE MADE RESPONSIBLE FOR DIS- 
SEMINATING INFORMATION ABOUT THEIR PROJECTS TO PAR- 
ENTS AND APPROPRIATE COMMUNITY AGENCIES ON A REGU- 
LAR BASIS. 

GENERAL RECOMMENDATIONS 

If we were to characterize the status of compensatory edu- 
cation in the State in a few phrases, we would say that it has 
seen worse times, it's getting better, and that we are at a 
stage of development when it is propitious to mobilize the im- 
pressive resources of the State and push for a dramatic improve- 
ment of compensatory education based on the considerable experi- 
ence that has been gained over the last several years. 

Given the magnitude of the educational problems facing dis- 
advantaged youngsters and the fact that deficits accumulate rapid- 
ly with passing time, it is imperative for methods of compensatory 




education that are highly successful to be identified^ as soon 
as possible and then be put into operation, by providing ade- 
quate rewards and incentives,^ in localities where evaluation 
demonstrates that little success is being achieved. Identify- 
ing such approaches may require a greater investment of re- 
sources initially but will pay off in the long run. 

In this connection it is important to bear in mind at least 
two basic criteria for program success; 

(1 ) That students achieve at a rate above the norm, and 



iQCQ Fourth Annual Report on Title I - 

Advisory Council on the Education of Disad- 
presents an example of comparisons made of 

They conclude, tenta- 
undoubted success of selected programs was 
clearly defined objectives; teaching limited 

® ''®^“®tion Of competing stimulil caHl- 
ully trained teachers; and, a small group approach." 

2 

^ Providing rewards and incentives for model oroarams ic 

thar"the^u'^^r Officf^J^FH Council's recommendation 

Strative anrf Education should explore both admini- 

2s^^iy ''® 9^ rewarding well -designed, suc- 

cessful programs and providing incentives for their eyn;inc-inn 

and Implementation by other schools." Page 5 of the 1969 

Fourth Annual Report on Title I. See also the recoLendatlon 

trtc“s"(S?1 ?1?-iarla“LnT"''^f to^ool Jls- 

Report) Suallty Education for M«.,- 

1^964' pa|2M! the tonmoSwealth of Massachu-" 
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(2) That students receiving compensatory education ex- 
hibit achievement levels statistically significantly 
higher than a comparable control group which does 
not have the compensatory treatment. 

Anything less than this will be an indication of program 
ineffectiveness.^ 

On the basis of this rationale, we feel the great need for 
the development of four kinds of models: Teacher Preparation 
Models; Evaluation Models; Curriculum Models; and, Models of 
Actual Compensatory Education Programs. We therefore recommend: 

(42) THAT THE STATE DEPARTMENT TITLE I OFFICE COLLABORATE 
WITH THE BOARD OF HIGHER EDUCATION, SELECTED INSTI- 
TUTIONS OF HIGHER LEARNING, AND PROMISING SCHOOL DIS- 
TRICTS IN THE DEVELOPMENT OF SEVERAL CAREFULLY DE- 
SIGNED COMPENSATORY EDUCATION MODELS WHICH CAN BE 
RIGOROUSLY EVALUATED^ AND RESULTS FROM WHICH CAN BE 

^ The American Institutes of Research under a contract with 
the National Advisory Council on Education of Disadvantaged Children 
compared successful and unsuccessful programs. They held that "an 
improvement in achievement scores was not considered sufficient 
by itself to identify a 'successful program.' The achieved gain 
had to exceed that made by a control group over a comparable period 
of time, or that to be expected on the basis of normative data, 
and had to be statistically significant." Title I - E.S.E.A: A 
Review and a Forward Look - 1969 . Fourth Annual Report of the 
National Advisory Council on the Education of Disadvantaged Children, 
(GPO 1969 0-331-372), 1969, p. 20. 

2 

We refer here to the kind of evaluation specified by Edward 
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DISSEMINATED TO OTHER PROJECTS. SUCH MODELS SHOULD 
BECOME DEMONSTRATION CENTERS WHERE STUDENT TEACHERS 
MAY BE TRAINED AND WHERE SITE VISITS MAY BE MADE BY 
THOSE WORKING IN COMPENSATORY EDUCATION;^ 

(43) THAT IN ORDER TO MEET A CRITICAL MANPOWER SHORTAGE 
IN COMPENSATORY EDUCATION, THE STATE DEPARTMENT OF 
EDUCATION, IN COLLABORATION WITH SELECTED INSTITU- 
TIONS OF HIGHER LEARNING AND PUBLIC SCHOOL SYSTEMS, 
GIVE TOP PRIORITY TO THE ESTABLISHMENT OF MODEL 
PROGRAMS, BOTH PRE-SERVICE AND IN-SERVICE, FOR TRAIN- 
ING A VARIETY OF COMPENSATORY EDUCATION PERSONNEL; 
THAT THESE PROGRAMS BE BASED ON UP-TO-DATE RESEARCH 



A. Suchman, in "Evaluating Education Programs," The Urban Review, 
vol. 3, no. 4, February, 1969, pp. 15-16. "The Tey conceptual 
elements in a definition of evaluation from a methodoloqical point 
of view are (1) a planned program of deliberate intervention, not 
just any natural or 'accidental' event; (2) an objective or goal 
which IS considered desirable or has some positive value, not simply 
whatever change occurs; and (3) t method for determining the de- 
gree to which the planned program achieves the desired objective. 
Evaluative research asks about the kind of change desired, the 
TOans by which this change is to be brought about, and the signs 
according to which such change can be recognized." See also, by 
thesame author. Evaluative Research ; Principles and Practices in 

Foundado^^hb/”^^”^^^^ Proqrams~ li^ York: Rii<;<;pn 

X consistent with recommendation b and 

c of The Wi (lis-Harnngton Report, p. 43. 
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FINDINGS CONCERNING LEARNING AND THE KINDS OF EXPERI- 
ENCES THAT ARE PREREQUISITE TO THE DEVELOPMENT OF 
COMPETENT LEARNERS, PARTICULARLY AS THESE EXPERIENCES 
RELATE TO THE DISADVANTAGED; THAT THEY INCLUDE MODEL 
COMPONENTS ON EVALUATION AND CURRICULUM; THAT THE PRO- 
GRAMS BE SELECTIVE IN WHOM THEY ADMIT AND RIGOROUS IN 
EXTENT AND DEPTH OF TRAINING; AND, THAT THEY BE CARE- 
FULLY EVALUATED. "I 

With so many unforeseen and uncertain contingencies on which 
federal funding rests, we recommend; 

(44) THAT THE STATE DEPARTMENT OF EDUCATION BEGIN TO EN- 
COURAGE SCHOOL DISTRICTS TO ASSUME PROGRESSIVELY 
MORE RESPONSIBILITY FOR FINANCING COMPENSATORY EDU- 
CATIONAL SERVICES AS A PART OF THEIR REGULAR SCHOOL 
BUDGETS.^ 



Please see the section on "Model Training Program for Com- 
pensatory Education Personnel" contained in Blueprint for Action 
the summary chapter of this document, for a reasonably well de- * 
tailed specification of a suggested model. 

ii;<y Some school districts have already begun to do this. Some 
15% Of the local districts increased their 1967-68 regular budgets 

Title I expenditures. (This figure 
Stcte s report to USOE. See paragraph 10 Source 
of Funding for information gleaned from our data.) 
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Our survey data indicate that there are over 30,000 children 
in the Cominonwealth who need compensatory services but aren't 
getting them. This represents a growing liability to the State 
which will be a far more costly problem to deal with when these 
children become adults. We reconvnend: 



(45) THAT LEGISLATION BE ENACTED TO APPROPRIATE STATE FUNDS 
TO SUPPLEMENT THE FEDERAL FUNDS FOR OVER 30,000 CHILDREN 
NEEDING COMPENSATORY SERVICES WHO ARE NOT NOW RECEIV- 
ING THEM AND FOR SETTING UP PROGRAMS TO TRAIN EVALUATION 
SPECIALISTS AND COMPENSATORY EDUCATION PERSONNEL. 



Many programs have similar objectives and problems. Without 
exchange of information among them, there is a duplication of 
effort and an unnecessary repetition of unsuccessful approaches. 

We therefore recommend: 

(46) THAT THE STATE DEPARTMENT OF EDUCATION HELP TO PROVIDE 
A GREATER DEGREE OF COORDINATION AMONG ALL COMPENSATORY 
EDUCATION PROGRAMS (HEADSTART, FOLLOW THROUGH, UPWARD 
BOUND, TEACHER CORPS, NEIGHBORHOOD YOUTH CORPS, ETC.) 
THOUGH SUCH MEANS AS DISSEMINATION OF INFORMATION, SPON- 
SORING CONFERENCES, AND WORKING DIRECTLY WITH THE DIF- 
FERENT PROGRAMS TO BRING THEIR PERSONNEL TOGETHER FOR 
CONSULTATION ON MUTUAL PROBLEMS. 



Our data show that most of the Title I programs include children 
in the early grades. On the strength of many research findings 
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which point out how certain early experiences are crucial to later 
learning, we believe that even more emphasis should be placed on 
reaching the very young. We therefore recommend: 

(47) THAT THE STATE DEPARTMENT OF EDUCATION ADOPT A GENERAL 
POLICY OF GIVING PRIORITY TO PREVENTION OF LEARNING 
DIFFICULTIES RATHER THAN ON REMEDIATION AND THAT CON- 
CRETE STEPS BE TAKEN TO EXPAND PRE-SCHOOL PROGRAMS AND 
THE TRAINING OF SPECIALISTS IN EARLY CHILDHOOD EDUCATION. 

Finally, because such study documents as this are frequently 
filed and forgotten after a short time, we recommend: 

(48) THAT THE STATE DEPARTMENT OF EDUCATION SET A DATE FOR 
AN ANNUAL REVIEW OF THE ABOVE RECOMMENDATIONS UNTIL 
THOSE WHICH ARE FOUND TO BE BOTH ACCEPTABLE AND FEASIBLE 
ARE CARRIED OUT AND THAT SOME APPROPRIATE OFFICE OR 
AGENCY BE CHARGED WITH THE RESPONSIBILITY OF THE REVIEW. 
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PART Ml: SUMMARY OF FINDINGS FROM ANALYSIS OF SURVEY DATA 



Data were collected from 173 school districts representing 302 
compensatory education projects. This represented a 70^ return on 
the survey forms sent out. The response rates from school dis- 
tricts by Standard Metropolitan Statistical Areas were as follows: 

.A (largest) B C D e (smallest) 

m m m m 55 ^ 

One hundred and forty school districts out of 247 fall into category 
"C." The average response rate was a little over 70/K. 

One of the primary purposes of the survey was to provide a 
cross-check on data gathered by interviews and observations from the 
10^ random sample. Selected data summaries taken from the survey 
forms may be found in Appendix IX, beginning on page 332. The fre- 
quency tabulations of project characteristics presented below appear 
in the order of the items relative to those characteristics on the 
survey questionnaires. (See Appendix IV, page 299.) 




DATA FROM SCHOOL DISTRICTS 



1 . Number of Disadvantaged Students Served ; The undupl i cated 
count of disadvantaged children being ser 'ed by all projects 
(counted by districts) was 70,047 (N = 173 districts). Projecting 
from this figure on the basis of a 70% return, the total number 
of children being served in the State would come to a little over 

100.000. This is consistent with the State Department's figure of 

103.000. 



2. Number of Disadvantaged Students in Districts ; The total 
number of disadvantaged students reported in the 173 districts was 
95,623 . On a projected basis from a 70% sample, this would come 
to around 138,000 in all districts. This may be a slightly in- 
flated estimate since more larger districts than smaller districts 
sent in reports and larger districts tend to have proportionally 
larger concentrations of disadvantaged students. The question- 
naire used by the Willis-Harrington investigators produced an esti- 
mate of 40,000 disadvantaged students in the State. At that time 
(1965), 108 districts reported no culturally disadvantaged children 
(36% of the respondents). They concluded, "It would appear that 
there are many children who have educational handicaps who could 
benefit from programs of compensatory education but who remain pres- 



ently unidentified,"^ For comparative purposes, we used the same 
definition they did when collecting data from the same sources. 

It appears that today many more of these children are being iden- 
tified. The estimate, based on reports from districts, is that 
about 35,000 children who need compensatory services are not getting 
them (about 25%). 

3. Total Number of Children in Districts : The total number 
of children in the 173 districts came to 917,017 . The disadvan- 
taged represent a little over 10% of the total number. This is 
somewhat lower than the lowest national estimate of 15%. 

4. University Assistance ; Universities were used most fre- 
quently for providing in-service training and assistance with 
evaluation and least often for assistance in determining budgets. 
(See data summary, page 352, for complete breakdown.) 

5. Weaknesses of Compensatory Education Programs ; In report- 
ing weaknesses of compensatory education programs, the two weaknesses 

^ Quality Education for Massachusetts ; An Investment in the 
People of the Commonwealth . Final Report of the Massachusetts House 
Special Commission Established to Make an Investigation and Study 
Relative to Improving and Extending Educational Facilities in the 
Commonwealth; Hon. Kevin B. Harrington, Chairman; Benjamin C. Willis, 
Executive Director; June, 1965, p. 294. 



most frequently mentioned were inadequate funding and the fact that 
too few children were being served. (See data summary, page 353, 
for complete tabulation.) 

6. Strengths of Programs : In response to a request for 

opinions on the two greatest strengths of the program, individual 
or small group teaching and dedicated, cooperative staff were 
most frequently mentioned. (See data summary, page 355.) 

7. Types of Assistance Needed from State Department ; Exclud- 
ing heavier funding, districts most frequently listed assistance 

in evaluation and consultation and in-service training as the kind 
of help they felt not now available from the Title I Office but 
which is badly needed. Needing better communication among projects 
also ranked high on the list. (See data summary, page 357, for 
complete breakdown. ) 

8. Assistance Needed from Universities ; The three kinds of 
assistance districts felt were most needed from universities and 
colleges and which were considered not now readily available were, 
in order of frequency: consultation on research and evaluation 
procedures, specific teacher training or in-service training, and 
provision of various kinds of professional advice or assistance. 
(See Appendix IX, page 359, for complete tabulation.) 



DATA ON PROJECTS WITHIN DISTRICTS 

9. Project Types; Title descriptions of projects were col- 
lected and tabulated. (See Appendix IX, page 361, for tabulation.) 
As noted before, the heaviest emphasis is in reading and language 
arts. Categories for tabulation were taken from the NEEDS-NESDEC 
Title I study and slightly modified for our purposes. 

10. So_urce of Funding: As for source of funding of the 302 
projects from which data were collected, 76.25K were financed by 
Title I; another 22% were funded or partially funded by federal 
sources; only Z% were locally funded (6 projects). (See Appendix 
IX, page 362, for complete breakdown.) 

The number of children served by the six locally funded pro- 
grams was 2,260; on a projected basis, one might expect the number 
of children being served by programs entirely supported by local 
resources to be between three and five thousand. Half of these 
programs had pre-service training; two of the six had in-service 
training; half were summer and half were winter; five of them had 
no evaluator; half of them concerned reading. It appears that these 
projects were formerly Title I programs continued on local funds. 

• lime of Project: Forty-three percent of the :<02 projects 

were held during the school year; 43.7% in the summer; 12.9% during 
both. 
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12. Number of Grades Included in Project ; About a quarter 
of the projects served 6 grades simulataneously; another quarter 
served 3 or 4 grades; about a quarter served 7 to 11 grades. (See 
complete tabulation, Appendix IX, page 363.) Twenty-five percent 
of the projects included kindergarten or pre-school; 44% included 
the first grade. Thus, the major thrust is with the younger 
students. 



13. Number of Disadvantaged Children Being Served ; Estimates 
from projects on disadvantaged children not being served differed 
considerably from estimates from school districts covering the 
same area. According to project estimates, 45% of the children in 
need of compensatory education are not getting it. (This percentage 
is likely to be inaccurate. It is based on estimates where the 
same child may be counted more than once, since several projects 
within a given district were making estimates on the number of children 
needing services and not getting them. Project estimates for total 
number of children not being served but needing it was 72,041 ; num- 
ber of disadvantaged children being served was 88,102 . Both of these 
numbers undoubtedly include many cases of counting the same child 
more than once.) The difference also probably reflects the differ- 
ence in the way district personnel view the extent of the need as 
compared to the way project personnel view it. At some point, there 
should be an effort made on the part of the State to take an accurate 



census of disadvantaged youngsters so we have a clearer picture 
of the magnitude of the job to be done. 

Number of Staf f Members : Three hundred and one projects 

reported ,3>074 full-time and 1 »631 part-time staff members. This 
represents an average 1:15 student- teacher ratio. 

Pre-service and In-service Training : Over 38 % of the 
projects (302) held pre-service training sessions of one week or 
more while 61.6% had in-service training related directly to the 
project on a regular basis. 

16. Evaluation : Over 45% of the 302 projects reporting as- 

signed a person to the project specifically forevaluation pur- 
poses. Around 11% of the projects assigned a staff member to 
evaluation work for 50% or more of his time. (See Appendix IX, 
page 364, for more detailed tabulation.) Approximately 37% of 
the projects reporting (302) had evaluators who participated in 
planning. Characteristics of project evaluations are tabulated in 
Appendix IX, page 364. 

With some minor exceptions, these survey data are consistent 
with observations made in the sample. 
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CROSS TABULAirONS 



Over 60 cross tabulations were run to determine the degree 
of certain relationships among project characteristics. Several 
of the more significant ones are summarized below: 

17. Testing Characteristics By Project Type : Projects 

described as reading, language arts, or general academic had a 
considerably higher than average use { 72 . 1 %) of pre-post testing 
(92.7%; 85.3%; and 84.1% respectively), while guidance and psy- 
chological services, vocational, and "other" types of projects 
had a considerably lower than average use of pre-post testing 
(40%; 40%; and 33% respectively). These differences were signifi- 
cant at the .01 level using a chi-square test. 

Reading projects reported greater than average (61.9%) use 
of standardized test programs (81.8%) while non-academic enrich- 
ment, vocational, and "other" projects reported significantly less 
use than average of standardized test programs (25%; 26.7%; and 
26.7% respectively). Differences calculated by chi-square test 
were significant at .01 level. 

Projects described as in-service training, non-academic en- 
richment, general remedial, and vocational had a significantly 
higher than average (41.7%) use of opinionnaires (100%; 75%; 62.5%; 
60%). Projects described as special classes and reading had a 
lower than average use of opinionnaires (21.4%; 29.1%). These 
differences were significant at the .05 level. 
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These results serve to emphasize the need for good evaluative 
instruments for the areas mentioned. 

18. Staff Training By Project Type and Time of Pro.iect : Non- 
academic enrichment and school readiness were considerably higher 
than average (61.6^) in reporting in-service training on a regular 
basis directly to the project (75%; 72.4%). Vocational and "other" 
projects were lowest in in-service training (40%; 46.7%). These 
differences are significant at .05 level. 

School readiness and non-academic enrichment projects had 
above average (38.7%) rates of pre-service training (55.2% and 50% 
respectively). General remedial and guidance and psychological 
services had considerably below the average rates (25% and 26.7%). 
These differences were significant at the .05 level. Proportionately 
more pre-service training was held in projects which ran during both 
summer and school year and summer only than in winter projects only 
(46.2%; 40%; 34.6%). Differences were significant at .01 level. 
Proportionately more in-service training was offered by projects 
which ran in the winter than in the summer (69.2% for winter as op- 
posed to 58.3% for summer; average was 61.6%). Differences were 
significant at the .01 level. There seems to be more time available 
for pre-service in the summer while in-service training seems to 
make more sense during projects of more extended duration. 




19. Evaluator By Project Type ; Non-academic enrichment, 
school readiness and academic instruction projects reported a 
significantly greater than average (45.7%) use of an evaluator 
assigned to the project specifically for evaluation (75%; 65.5%; 
59.1%). Guidance and psychological services were significantly 
less likely than average to have an evaluator assigned (26.7%). 

20. Time of Project By Type ; Guidance and psychological 
services, special classes, and instructional services type pro- 
jects were significantly above the average (43%) in reporting 
school year programs (80%; 78.6%; 77.1%). General remedial and 
non-academic projects tended to be above the average (43.7%) in 
occurring in the summer (80%; 75%). These differences were 
significant at the .01 level. 




APPENDICES (I through VII) 



ERIC 

hiaifiiifftaiTiTaaa 



Ff.7 



APPENDIX I 



P^ractical Activities Associated with the Project 



Since our purpose in carrying out an evaluation of compensa- 
tory education programs in Massachusetts was to help find ways of 
improving evaluation so that modification for improvement might 
be introduced, the project study staff engaged in a number of ac- 
tivities not directly related to the study but which were designed 
to help facilitate modification. 

Among the most important of these were two conferences, one 
held in March and the other in July. During these conferences, 
attended by members of the Advisory Council and representatives from 
projects in our sample, critical issues in compensatory education 
with particular reference to problems in evaluation were discussed. 

The first conference was intended to give a general overview of 
the study and to present federal, state, and university personnel to 
discuss Title I evaluation and interact with persons from local pro- 
jects. 

Dr. Daniel Jordan, Project Director, presented an over- 
view of the study; 

Miss Janice Meissner, consultant to the State Depart- 
ment of Education spoke on the State Evaluation of Title I; 




Mr. Robert Jeffery, Project Director of Title I for the 
State spoke or. the implications of the State Report on 
Title I; 

Dr. Marvin Cline led a workshop on "Short-term Evalua- 
tions"; 

Dr. Daniel Jordan made a presentation on "Critical Vari- 
ables in Compensatory Education"; 

Dr. James Fortune held a session on "Decisions Confront- 
ing the Evaluator"; and, 

Dr. Charles Hammer, Title I Office in Washington, held an 
informal question and answer period on evaluation problems. 

The second conference was a two-day workshop, the program for which 
was as follows: 

"Writing Behavioral Objectives"— Mr. Ray Johnson 

"Model Programs— Development and Evaluation Design"— 

Dr. Marvin Cline and Dr. James Fortune 

"Information Dissemination"— Dr. Richard Hackney 

"PERT Charting"— Mr. George Worle 

"Self-Image in Compensatory Education"--Dr. Daniel Jordan 
"Helping the Disadvantaged Child"— Dr. William Kvaraceus 
"Testing— What It Can and Cannot Do"— Dr. David Berliner 
"Testing Workshop on Reading"— Dr. David Yarington 
"Testing Workshop on Intel 1 igence"— Dr. Marvin Cline 
"Testing Workshop on Attitudes"— Dr. David Berliner 
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Information on these conferences and other items pertinent 
to compensatory education were disseminated to all Title I programs 
in the State by means of a newsletter. Other publications include 
articles on the project and compensatory education in the Spring, 
1969, issue of Trend magazine^ 

A comprehensive review of the literature on compensatory edu~ 
cation, undertaken as a prelude to the formation of the question- 
naire and observation protocol, was summarized by the Project Direc- 
tor in an article on Teaching the Disadvantaged which will appear as 
a chapter in the new Handbook for Teachers , soon to be published by 
Scott-Foresman. 

Brief reports containing observations and recommendations made 
by site visitors were written up and distributed to the superinten- 
dents under whose jurisdiction Title I projects in our sample fell. 

The fact that the study was being undertaken by staff and stu- 
dents in the School of Education helped to create interest sufficient 
to initiate the establishment of a program in compensatory education 
which will eventually provide pre-service and in-service training 



^ Jordan, Daniel C. , "People with Answers Needed to Educate the 
Disadvantaged," Trend, Spring, 1969, vol. V, no. 3, page 52. 

"Improving Compensatory Education in 
Massachusetts," Trend, Spring, 1969, vol. V. no. 3, page 41. 



for those who want to prepare for teaching, research and evaluation, 
and curriculum development in compensatory education. 

Considerable consultation has been held with the State Depart- 
ment Title I Office for the purpose of exploring ways and means of 
improving compensatory education services throughout the State. As 
a result of some of these consultations, the Massachusetts Advisory 
Council on Education has identified and published a list of universi- 
ty personnel who are willing and able to serve as consultants to 
Title I projects on their evaluation. On the 22nd of October, 1969, 
the Massachusetts Advisory Council on Education, in collaboration with 
the Title I Office in the State Department, hosted a conference for 
these consultants. At this conference, staff members of our study 
presented preliminary findings. 

The Title I Office in the State Department also held a series of 
regional conferences discussing problems and new guidelines for Title 
I proposals for the coming year. Members of our staff were also invited 
to present preliminary findings on our study at these conferences. 

As a result of our conference activity and visits to projects in 
the sample, principals, superintendents, and other staff members of 
projects in our sample have visited the campus for the purpose of con- 
sulting on specific problems and exploring ways and means of collaborat- 
ing with the University for the purpose of improving compensatory ser- 
vices. 
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Finally, the School of Education has submitted to different 
funding agencies a number of proposals for setting up the kind of 
research and training program in compensatory education that 

would represent an implementation of many of the recomnendations 
of this document. 




APPENDIX II 



Projects in the Sample 



Athol Public Schools 
"Camp Scholar" 

Barnstable Public Schools 
"Remedial Reading" 

Bedford Public Schools 
"Operation Bootstrap" 

Boston Public Schools 
"Compensatory Services" 

Boxford Public Schools 

"Teacher Coaches for Poor Achievers" 

Bridgewater-Raynham Regional 
School District 

"Words and Color: Remedial Reading" 

Brookline Public Schools 
"Extension and Enrichment of 
Curriculum" 

Buckland-Shelburne Regional School 
District, "Catch-up II" 

Cohasset Public Schools 
"Special Counselor" 

Fairhaven Public Schools 
"After School Tutorial" 



Gloucester Public Schools 
"Camp Plum Cove" 

Hanover Public Schools 
"Improving Reading Level" 

Holyoke Public Schools 
"English to Puerto Ricans" 

"Summer Head Start" 

Hopedale Public Schools 
"Remedial Reading and Special 
Therapy" 

King Philip Regional School 
District, "Remedial Reading" 

Lenox Public Schools 
"Summer Remedial Reading" 

Ludlow Public Schools 
"Stimulation" 

Masconomet Regional School 
District, "Aide to Slow Learners" 

Medfleld Public Schools 
"Project Respond" 

Mendon-Upton Regional School 
District, "Growth Through Reading" 
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Milford Public Schools 
"Development of Reading and Math" 

Millville Public Schools 
"R.S.P." 

New Bedford Public Schools 
"Compensatory Services" 

Newburyport Public Schools 
"Broad Horizons" 

Oxford Public Schools 
"Taped Teaching" 

Palmer Public Schools 
"Improving Language Skills" 

Plainville Public Schools 
"Opportunity Class" 

Plymouth Public Schools 
"Operation Keep Pace" 

Quincy Public Schools 
"Comprehensive Program" 

Reading Public Schools 
"Improving Reading" 

Southern Berkshire Regional School 
District, "Summer Work Study" 

Superintendency Union #43 - North 
Berkshire, "Project Boost" 



Superintendency Union #61 - 
Sturbridge, "Summer Cultural 
Program" 

Sutton Public Schools 

"Summer Tutorial Type Instruction 

Swansea Public Schools 
"Pre-kindergarten Program" 

Taunton Public Schools 
"Title I Summer Program" 

Waltham Public Schools 
"Operation Mainspring" 

Westfield Public Schools 
"Improving Reading Skills" 

Williamstown Public Schools 
"Teacher Aide Program" 

Wilmington Public Schools 
"Saturday Reading Program" 

Woburn Public Schools 
"Ungraded Class for Non-English" 

Wrentham Public Schools 
"Aid to Underachievers" 





APPENDIX III 



Questionnaire and Observation Protocol Used for the Evaluation of 
Projects in the Sample in Narrative Form with Commentary 



The protocol used was designed to meet the needs and purposes 
of the study while at the same time reflecting a reasonably compre- 
hensive view of the research literature on compensatory education. 

It is organized in two parts: Part I contains questions and points 

for observation which relate to a given project's own planning and 
evaluation procedures; Part II contains questions and observations 
which are pertinent to variables which research has demonstrated to 
be critical to the success of compensatory education programs. Each 
part contains several sub-sections of related questions to be asked 
and important observations to be made. 






PART I: QUESTIONS AND OBSERVATIONS CONCERNING PLANNING AND EVALUATION 



A. PLANNING PROCEDURES 

1. Who was Involved 1n the planning process? 

Since evaluation 1s based on a determination of 
how well efforts are achieving objectives, judgments 
about the quality of a project's evaluation activities 
will depend, at least in part, on what objectives were 
adopted and how they were formulated as part of the 
planning process. Thus, information was gathered on 
all aspects of project planning. 

We were interested in finding out how extensive 
were the personnel resources used in planning; where 
the executive power in making planning decisions was 
located; to what extent universities and colleges were 
involved in planning; whether or not Title I students 
and Title I parents had a say in the planning of pro- 
jects which will affect them; and, to what extent the 
school assumed leadership in cooperative planning with 
other agencies which might be pertinent to the achieve- 
ment of project objectives, such as Community Action 
Program agencies, welfare agencies. Public Health Ser- 
vice agencies, etc. 



How were the student needs on which the project was 
based determined? 

Of particular concern here was information on 
the actual needs, how they were identified, and whether 

or not and how priorities amonq the needs were deter- 
mined. 

How much time was there for planning? 

Exploration of this question included gathering 
data on the amount of time between the planning and the 
start of the project. The time factor has obvious im- 
plications for program quality. 

Is this year's program a repeat of last year's program? 

This question was extended into a consideration of 
the rationale for repeating or not repeating a project, 
ascertaining what kinds of revisions had been made and 
on what basis, and whether or not the previous fiscal 
year's project evaluation was used in making a decision 
about whether or not to repeat the project or to make re 
visions. 



What plans were made for in-service training? 



In some cases in-service training is regarded as 
a project activity which therefore needs some careful 
planning. We were interested in finding out how the 
in-service training as a project activity was planned, 
who was involved in the planning, and how the in-service 
training related to project objectives. (See section B 
for information on project objectives.) 

6. Did the project planners determine the evaluation pro- 
cedures? 

Since the evaluation aspects of many projects are 
added after the planning has been carried out, and in 
some cases even after the program has been implemented, 
we were interested in the vital question of the relation- 
ship between planning and evaluation and to determine the 
degree to which evaluation was present in the minds of 
those who actually planned the project. 

7. Were there ar\y theoretical foundations to the planning? 

Since so many programs come into being with no re- 
gard to research findings or useful theory, we were in- 
terested in ascertaining the extent to which Title I pro- 
gram planners adopted any predetermined and conscious 
theoretical basis for making planning decisions. For 
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instance, special attention was given to whether or 
not the planners decided to have a structured or un- 
structured program based on some theoretical orienta- 
tion to this question. 

B. FORMULATION OF PROJECT OBJECTIVES 

8. Have project objectives been defined in behavioral terms? 

Since one of the perennial difficulties in evalu- 
ating programs is related to the fact that objectives 
are not stated in^any measurable form, we were inter- 
ested in finding out to what extent project planners 
were able to form their objectives in precise enough 
terms to permit adequate evaluation. We were also in- 
terested in ascertaining whether or not success criteria 
were established for individual students and for the pro- 
ject as a whol.e and whether or not degrees of accom- 
plishment or outcomes were specified for each of the ob- 
jectives (so that project administrators might know the 
extent to which they were approximating their goals). 

9. What relationship did project objectives have to assessed 
needs? 

Obviously, if a program is going to fulfill actual 
needs, project objectives should be based upon a careful 



assessment of needs. We were interested in deter- 
mining how well organized the planning procedure was 
and the extent to which objectives were relevant be- 
cause they bore a direct relationship to assessed 
needs. We were also interested to note whether or not 
project planners formulated objectives based on a con- 
sideration of the fact that most Title I pupils are 
behind when they enter the project and that they have 
to achieve at a rate above the norm if they are to 
catch up. Related to this point is the question of 
time allocation for project activity. We were inter- 
ested to see how the amount of time allocated for pro- 
ject activity was determined and how much actual time 
was devoted to it. 

10. Was there agreement and understanding on project ob- 
jectives among staff members? 

One of the common causes of organizational ineffec- 
tiveness is the fact that many people in the organization 
have no conscious notion of the objectives of the organ- 
ization of which they are a part. Observers were inter- 
viewed to find out the extent to which project staff 
understood the project's objectives and agreed with them 
and the degree to which staff members maintained a common 
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implementational commitment to the priority of ob- 
jectives. 

C. SELECTION OF PROJECT PARTICIPANTS 

n. What criteria were used to select students for Title I 
projects? 

Title I legislation is geared for a particular tar- 
get population} namely those who are disadvantaged. The 
purpose of this question was to determine to what extent 
and in what ways projects identified members of the target 
population and to see to what extent different projects 
reflect similar or dissimilar notions of the kinds of 
students who should be in Title I programs. Obviously, 
project objectives and plans should be geared to meet the 
needs of this population. 

12. What were the diagnostic measures taken, if any? 

Diagnostic measures are important in assessing needs 
and therefore useful in determining program objectives 
and content. 

r' ■ 

D. PROJECT EVALUATION 

13. What kind of evaluation design was used? 



E^C 





Where possible, observers used the "X and 0" 
format of Campbell and Stanley as reported in Gage's 
Handbook of Research in Teaching^ for describing the 
basic structure of evaluation designs used by the pro- 
jects. We were interested to note the range of 'iasigns, 
if any, and their levels of sophistication, since the 
more sophisticated and appropriate the design, the better 
feedback for program improvement. Observations .were 
made to determine whether or not the design incited 
comparison as well as treatment groups and, if so, how 
the comparison group was selected; whether or not treat- 
ments or conditions were applied or held constant through- 
out the project; whether or not there had been a dif- 
ferential loss of respondents from the comparison groups; 
and, whether or not the comparison group was in a para- 
llel program. 



Campbell, Donald T., and Stanley, Julian C., "Experimental and 
Quasi -experimental Designs for Research on Teaching," in Gage, N.L. (Ed.) 
Handbook of Research on Teaching , Rand McNally A Co., Chicago, 1963. 

A modified form of the Campbell and Stanley code for describing 
the evaluation designs was used, in which X = exposure of a group to 
an experimental variable or event (treatment) and 0 = process of ob- 
servation or measurement. The graphic presentation of the design can 
be used to analyze experimental strengths and weaknesses of the evalu- 
ation in respect to project concerns. 
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One aspect of some projects' organization made 
them more difficult to evaluate than others, namely, 
the involvement of a cooperative arrangement with 
several institutions, particularly those that were 
non-public. Inquiry was made to glean information on 
how the evaluation was carried out in these kinds of 
projects and who did it. 

If the evaluation design adopted a specific measure- 
ment procedure utilizing pre- and post-tests, informa- 
tion was collected to determine whether or not project 
personnel considered the importance of making certain 
that nothing other than the experimental variables oc- 
curred between the first and second measurements unless 
accounted for in some way. 

Inquiry was also made to ascertain whether or not 
project directors or evaluators made any systematic at- 
tempt to describe and measure any of the characteristics 
of the physical and social environment which were thought 
to be relevant to the outcomes of the project. For in- 
stance, the grading philosophy or grading system of a 
project may have as much or more effect on performance 
as other pedagogical concerns, such as relevance of 
curriculum materials, etc. 




It frequently happens that a project evaluation 
focuses only on one or two aspects of the program. 

Thus, note was taken if there were any project activi- 
ties which were thought to be meaningful that were 
not included in the evaluation. 

Since some program effects may not be felt for a 
year or more, note was made of all longitudinal in- 
vestigations of Title I efforts and all programs which 
included efforts to follow each student over more than 
a period of a year. 

Finally, it was determined whether or not the pro- 
ject planners or evaluators had devised and were using 
a schedule, such as PERT charting, for the evaluation 
process itself. 

14. What means were used to measure student performance? 

All standardized tests used in measuring student 
performance were tabulated; locally made tests were col- 
lected or described; and, other sources and methods of 
collecting information such as questionnaires, logs, 
attendance records, anecdotal records, and unobtrusive 
measures were described and their source noted, i.e., 
staff members, community agencies, parents, or students. 
We also inquired as to whether or not tests were given 

2§4 

ERIC 



304 



regularly within the school or whether or not there 
was special testing in the Title I project itself. Of 
particular concern here was finding out whether or not 
there were any types of baseline data available that were 
different from pre-tests and in what way these data were 
used. Information was also gathered on: the relation- 
ship of data collected to project objectives; whether 
or not consideration was given to the reliability and 
validity of the tests used; whether or not evaluators were 
sensitive to the fact that changes in observers, scorers, 
or calibration of measuring instruments can influence 
changes in the obtained measurements; and, grading phi- 
losophies-. 

How were project data analyzed? 

Information was obtained on how the data were ana- 
lyzed and by whom; what statistical procedures were used 
in the treatment of the data; whether or not evaluators 
took into consideration that measurements of groups se- 
lected on the basis of their extreme scores may reflect 
in their post-tests a statistical regression toward the 
mean; whether or not evaluators took into consideration 
the fact that normal maturation will produce within each 
student a degree of progress related to nothing else other 
than the function of the passage of time. 



16. Was there any attempt to relate the project' s results 
with the needs assessed? 

If project results are not filling assessed 
needs, then it is clear that modifications must be 
introduced into the program. 

E. PROGRAM MODIFICATION 

17. What is the form of the evaluation report and does it 
discuss implications for modification? 

The form of the report is often a powerful determi- 
nant as to how it will be used. We were interested to 
note: whether or not evaluation reports were turned in 
merely as a fulfillment of a requirement of the State 
Department or whether or not the report took on dif- 
ferent forms which might make it maximally useful to 
project staff members in modifying certain aspects of 
the program; and, whether or not it contained a dis- 
cussion of implications or recommendations for modifi- 
cation. 

18. What were the characteristics of the dissemination of 
evaluation results? 

Since the decision to modify a program ought to be 
based on evaluation, we were interested to find out how 



evaluation results were disseminated: who got the 

report; when the results were communicated; whether 
or not there was a formal mechanism in operation so 
that upon the analysis of feedback, the project could 
be quickly modified (i.e., through weekly meetings to 
discuss project progress); whether or not the evalua- 
tion was used in replanning a project; whether or not 
information on the progress of individual children who 
were removed from the regular classroom was reported 
to their regular classroom teacher in any systematic 
way; and, whether or not techniques, materials, and 
teaching approaches used in Title I projects had been 
communicated to the regular school program and whether 
or not they had been incorporated into the regular 
school program. 

19. What were the opinions of project directors and staff 
members concerning the success and/or values of the 
project? 

We were interested to find out the opinions of 
project directors and staff members on the effective- 
ness of the projects and to determine the extent to 
which there was inter-staff agreement. Staff members 
were asked what changes they would make if they were 



to start the program from the beginning again and 
whether or not any of the changes they would like to 
make had been incorporated or were going to be in- 
corporated when the program is replanned. They were 
asked to indicate some of the chief negative outcomes 
of the project which were not anticipated, whether or 
not these were reported in the evaluation report and 
what were some of the unanticipated positive outcomes 
of the project and whether or not these were incor- 
porated into the report. 

20. Was the evaluation process itself evaluated? 

Obviously a poor evaluation procedure or design 
will not yield the kind of results which will enable 
a project director to modify his program with the aim of 
improving it in any sensible and systematic way. It 
is therefore necessary to evaluate the evaluation pro- 
cedures in a given project so that evaluation itself 
might be improved. Inquiry was made as to whether or 
not project directors considered the evaluation pro- 
cedures to have been successful or unsuccessful based 
on their experience. 

21. Was any attempt made to carry out a cost accounting 
analysis of the project? 
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An evaluation is not complete if it does not 
include information that will enable a judgment to 
be made as to whether or not the cost of the project 
is reasonable in light of what it accomplished. 

part II : QUESTIONS AND OBSERVATIONS ON VARIABLES IMPORTANT TO COM- 
PENSATORY EDUCATION 

Since evaluation refers to the process of determining how well 
project objectives are being achieved, it is possible for a project 
to appear highly successful, even though the objectives being achieved 
are inappropriate or irrelevant to the main purpose of compensatory 
education. It is therefore essential to consider the appropriateness 
of objectives and the degree to which these objectives reflect an aware- 
ness of research findings relevant to compensatory education. Thus, the 
observations and questions of this part were designed to glean informa- 
tion from projects pertinent to variables which research has demonstrated 
to be critical to the success of compensatory education programs. 

P- STAFF CHARACTERISTICS, SELECTION, RECRUITMENT 

1. Characteristics of project teachers and administrators. 

Information was collected on amount and kind of prior 
experience of staff members, particularly in relationship 
to the present assignment of the Title I staff, length of 






time with the system, whether or not staff members 
volunteered or were assigned to their positions, and 
the amount of time that was allocated for assignments. 
Of particular concern here was whether or not the re- 
sponsibility of the direction of the project was an 
added duty to an already full load or a partial or 
new full-time position. 

2. Supporting staff. 

If the project employed support staff, such as 
teacher aides and/or other para-professionals, informa- 
tion on their backgrounds, duties, training, and the 
way in which they were utilized was gathered. 

3. Staff characteristics related to ability to establish 
rapport with students. 

Research in this area has indicated the importance 
of the capacity of a teacher to establish rapport with 
disadvantaged youngsters if they are to learn with any 
degree of efficiency. We therefore gathered information 
on the teacher's attitude toward the disadvantaged 
child's learning ability, the Title I project, the 
school in general, his/her own assessment of capacity 
in the project, and on the characteristics of the ex- 
pections of teachers with regard to pupil performance. 







In addition, we were interested to see to what extent 
Title I projects serving different racial or ethnic 
groups made efforts to provide teachers, aides, or 
administrators of the project from the same ethnic 
group as the majority of the children and whether 
or not Title I staff members lived in areas similar 
to those of the students whom they were teaching. 

4. Attitude of non-Title I personnel toward the project. 

In some Title I programs, a cleavage between non- 
Title I personnel and Title I staff puts the Title I 
child into a position where he bears the brunt of 
staff disunity. We were therefore interested in find- 
ing out the prevailing attitudes of non-Title I per- 
sonnel towards the project. 

PRE-SERVICE AND IN-SERVICE TRAINING 

5. Description of training of Title I staff. 

Both pre-service and in-service training of Title 
I personnel were considered. Specific note was taken 
as to whether or not teachers had had training which 
included role playing, microteaching, strength train- 
ing, and utilization of games in teaching. Information 
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was also gathered on how long the pre-service and 
in-service training was and who was in charge of it. 

H. LEARNING HOW TO LEARN-DEVELOPING EFFECTIVE LEARNERS 

6. Teaching the process of learning. 

The essential feature of a good compensatory edu- 
cation program is adequate provision for means that 
will enable disadvantaged youngsters to become per- 
manently effective learners. This involves learning 
something about how to learn itself. We were therefore 
interested in ascertaining whether or not compensatory 
education programs actually taught or offered experi- 
ences which would increase the competence of the learn- 
er by enabling him to understand something about the 
nature of knowledge and recall, techniques for compre- 
hension and transferability of knowledge, how to apply 
principles, how to analyze and synthesize material, how 
to perform evaluations of materials, and convergent and 
divergent thinking. 

7. General skills and capacities related to learning. 

Attempts were made to identify any part of a given 
project which focused on the development of any of the 
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following capacities: listening, observing, record- 

ing information, attending behavior and increasing 
attention span, test taking, following directions, 
effective work and study habits, visual discrimina- 
tion, vocabulary and word reasoning, speech, informa- 
tion seeki ng behavior (how to ask questions and where 
to find information), problem solving, and participa- 
tion in a group as a member. All of the above capaci- 
ties are known to contribute to efficiency in learning 
and therefore should be a part of every wel 1 -developed 
compensatory education program. 

motivational aspects of the program 

8. Individualized prescriptions for learning. 

In order to avoid setting children up for failure 
it is essential to know where they are and to make in- 
dividualized prescriptions for learning consistent with 
their present status. We were therefore interested in 
having information on whether or not such individualized 
prescriptions for learning were made, how they were made, 
whether or not there was an emphasis on the strengths 
or weaknesses of the pupils and whether or not considera- 
tion was given to the interests of students. 
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9. Basis for curriculum preparation. 

Motivation has been found to be in part dependent 
upon the relevance of curriculum materials from which 
students must learn. We were therefore interested to 
know whether or not and to what extent the curriculum 
for the program was planned to be consistent with stu- 
dents' environments, experiences, abilities, and inter- 
ests. We also looked for evidence of specific favor- 
able verbal and non-verbal reference to racial and cul- 
tural minority groups within the materials and teaching 
techniques employed. 

10. Presentation mode. 

Since research evidence indicates that the follow- 
ing presentation modes facilitate learning, we inquired 
as to whether or not projects made provision for them: 

Organization of material in short, sequential 
steps as needed; 

Continuous and immediate success experiences 
with immediate feedback being viewed as an im- 
portant reinforcer; 

Adequate evaluation of where the child is at any 
given point and his readiness for the next step 

Use of t.he "saturation approach" (repetition. 
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summarization, alternative explanations 
use of connecting links with different 
and, 



> and 

contexts); 



Multi -media presentation. 



11. Handling of frustration and failure. 

Many disadvantaged youngsters have a background 
of failure which figures strongly in present frustra- 
tions with learning. The distribution of rewards and 
punishments can have a direct effect on reducing or 
increasing frustration and failure. Inquiry was made 
as to whether or not projects had adopted a consistent 
policy concerning reward and punishment, whether or 
not the project capitalized on student interests as a 
means of fostering motivation, and whether or not ac- 
tivities were arranged so that children could experi- 
ence a sense of mastery and achievement (competency 
motivation) and consolidate gains made in this direc- 
tion by having the opportunity to use what was learned. 



12. Self-image. 

During the last several years, self-image has 
emerged as a useful conceptualization of how a person 
regards himself and how that self-regard in turn deter- 
mines behavior. Since so many recent efforts in com- 
pensatory education have dealt with "improvement of 
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self-image" as an objective of compensatory educa- 
tion, we gathered information on the extent to which 
projects made any attempt to analyze the self-concepts 
of children and whether or not there were specific 
aspects of the project which were planned as appropri- 
ate means for developing healthier self-concepts 
(such as systematic use of role models or systematic 
use of a variety of reinforcements following achieve- 
ment on any level). 

13. Levels of involvement. 

It has been found that learning on the part of the 
disadvantaged can be greatly facilitated if they do not 
have to remain passive recipients of information but in 
fact can become involved in doing things. For this rea- 
son, we were interested to ascertain whether or not 
projects employed means of involving youngsters and mak- 
ing them more active participants in the learning 
process through games, dramatics, role playing, and use 
of peers as teachers. 

14. Special instructional materials. 

The individualization of instruction can be facili- 
tated by the use of a wide variety of different instruc- 
tional materials and equipment. Information was gathered 
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as to the kind of special Instructional materials 
and equipment that was available, whether It was 
utilized or not, what was being locally developed, 
and whether or not project personnel had access to 
facilities for creating overheads, film strips, still 
photos and slides, moving films, tape recordings, and 
video-tapes. 

15. Class size aiid characteristics. 

A smaller class size can facilitate the Individual 
zatlon of Instruction. Therefore, we collected data on 
class size and pupll/teacher ratio. We were also In- 
terested to see whether or not classes were ethnically 
Integrated since studies have shown that Integration 
facilitates learning on the part of minority groups but 
does not depress learning of the majority. 

J. PARENTAL, HOME, AND COMMUNITY INVOLVEMENT 

16. Parental support. 

Studies have shown that significant Individuals 
In the lives of students have an Important bearing 
upon learning In school. We were therefore Interested 
In whether or not projects recognize the nature of 
this Influence and whether or not they had a program 



o 

ERIC 



317 



designed to involve parents and, if so, the nature 
of this program. 

17. Community support. 

Since the progress of a child in school is in 
many cases also directly related to his connections 
with other parts of the community in which he lives, 
we were interested to find out the nature and extent 
of community involvement in compensatory education 
programs. We inquired specifically as to whether 
or not any given program had a referral service where- 
by teachers and/or other project staff, recognizing 
certain problems or deficiencies among students, could 
call upon other agencies for assistance (such as wel- 
fare agencies, charitable institutions who could pro- 
vide clothing, clinics to provide medical attention, 
dental care, glasses, etc.). In this connection we 
were also interested to find out whether or not any 
program made provision for maintaining adequate nutri- 
tional status of students. 
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APPENDIX IV 



General Survey Forms 



GREEN FORM (General information — to be answered only once.) 

1. Estimate undupl i cated count of children being served by all pro- 
jects submitted on yellow sheets 

2. Estimate the total number of school age educationally disadvan- 
taged children and youth in your school district . 

Total number of school age children in district ^ 

(See definition of educationally disadvantaged in the covering 
letter.) 

3. Did you have any assistance from a college or university? Check 
the following items which may be appropriate: 

diagnosing needs curriculum development 

selecting population to be served in-service training of staff 

program planning pre-service training of staff 

evaluation b udget determination 

other— specify 

4. In your opinion, what are the two greatest weaknesses of your pro- 
jects? 



5. In your opinion, what are the two greatest strengths? 



(Please see page 240 regarding use of general survey forms.) 
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6. By projects, what is the most important assistance not now available 
which you would like to have from the State Department of Education 
(excluding heavier funding)? 

Project Title Assistance 



7. In your opinion, what is the most important assistance not now avail- 
able that can be given to your program from universities and colleges? 



Send to: 



Dan Jordan Name 

School of Education ^oTition 

University of Massachusetts Date 

Amherst, Mass. 01002 School System 

No. of yellow forms accompanying this Phone No. 

response . 




YELLOW FORM (Project Infonnation--to be answered for each project on a 
separate yellow sheet.) 



What project(s) in compensatory education are in operation (9/68 through 
8/69) in your school system? 

1. Official Title 

^ • 

2. A brief description. 



3. Specific sources of funding. (Specify, e.g., ESEA I, III, VI, VII, 

VIII, Follow Through, Voc. Ed. Act, other federal sources, state 
sources, local sources, foundations.) 

4. School year/summer. 

5. Grade level of children served . 

6. Number of children being served . 

7. Estimate how many children needing this service are not being 
served 



8. How many persons are on the project staff? full-time part-time_ 

a. Does the staff have a minimum of one week pre-service training 

specifically for this project? Yes No ^ 

b. Does the staff have any in-service training on a regular basis, 
directly related to the project? Yes No 

9. Has a person been assigned to the project staff specifically for 
evaluation purposes? Yes No 
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a. If yes, how much of his/her time is devoted to this task? % 

b. Did this person participate in the planning of this project? 

Yes No 

10. Check all of the following which describe your evaluation. 

Pre-test, post-test Teacher observations 

Use of control groups Standardized test program 

Operations data Descriptive report to 

(budget, facilities, time, etc.) sponsoring agency 

Opinionaire No evaluation 

Other 

11. How do you use this evaluation information. When is it used? 



School System 



APPENDIX V 



Code Sheet for Methods and Sources 



The code for a particular source and method of obtaining in- 
formation can be found by taking the number of the source and the 
letter of the method of obtaining information. (See examples fol- 
lowing code.) 



SOURCE 

1. Superintendent 

2. Principal 

3. Project Director 

4. Evaluator 

5. Title I teacher 

6. Non-Title I teacher 

7. Title I student 

8. Non-Title I student 

9. Parent of Title I child 

10. Parent of Non-Title I child 

11. Clerk 

12. Janitor 

13. Community Person 

14. Teacher Aide 

15. Volunteers 

16. Reading Specialist 

17. Specialist (specify) 

18. Other (specify) 

19. Applications 

20. Evaluation Reports 

21. Written material (specify) 

22. Other (specify) 



23. Title I Classroom 

24. Non-Title I Classroom 

25. Title I activity (specify) 

26. Non-Title I activity (specify) 

27. Committees & Organizational 
meeting (specify) 

28. Other (specify) 

X Assistant Administrative 
Personnel* 



METHODS 

A. Observation 

B. Direct questioning 

C. Indirect questioning 

D. Conversation and discussion 

E. Reading 

F. Personal Opinion 

G. Other (specify) 

Numbers 1-18 refer to human sources 
Numbers 19-22 refer to collected materials 
Numbers 23-28 refer to groups and places 



* A subj^ signifies an assistant (e.g., assistant principal, assistant 
superintendent, etc.). 





Code and Method Examples 

1C Indirect Questioning (C) of the Superintendent (1) 

19E Reading (E) a Project Application (19) 

3 B Direct Questioning (6) of an Assistant Project Director (3 ) 

7AD Observation (A) and Conversation and Discussion (D) with a 
Title I stud nt (7) 
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Data Sumnarles 
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DATA SUMMARY 

Naeds as ranked by projects in the sample (N = 43). 

S ummer 

Need 1st 2nd 3rd Total 



1. Reading improvement 7 3 0 10 4 1 1 6 16 



2. 


Improve self-image 


4 


4 


4 


12 


1 


1 


1 


3 


15 


3. 


Improve attitude toward 
school 


2 


3 


1 


6 


0 


0 


1 


1 


7 


4. 


Cultural enrichment 


0 


1 


4 


5 


0 


0 


1 


1 


6 


5. 


Language (verbalization) 


0 


2 


1 


3 


0 


1 


1 


2 


5 


6. 


Academic skills 


0 


1 


1 


2 


0 


1 


0 


1 


3 


7. 


Improve performance on 


1 


n 


1 


o 


1 


n 




1 






standardized test 


U 


c 


0 


0 


3 


8. 


Remediation of specific 






















learning handicaps (per- 
ceptual handicao) 


0 


0 


0 


0 


1 


1 


0 


2 


2 


9. 


Knowledge of English 


0 


0 


0 


0 


2 


0 


c 


2 


2 


10. 


Math skii ;s improvement 


2 


0 


0 


2 


0 


0 


0 


0 


2 


11. 


Social adjustment 


0 


0 


1 


1 


0 


0 


0 


0 


1 


12. 


Improve racial balance 


0 


0 


0 


0 


1 


0 


0 


1 


1 


13. 


Assist mentally retarded 


0 


0 


0 


0 


1 


0 


0 


1 


1 



Other kinds of needs not related directly to Individual students were mentioned, though infre- 
quently, such as decrease drop-out rate, decrease grade failure rate, need for challenging 
curriculum, pre-school programs, etc. (For discussion, please see page 137.) 



1st 



Winter 

2nd 3rd Total 



Grand 

Total 
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DATA SUMMARY 



Amount of time between planning and start of program (N * 34). 



Amount of time 


Sunmer projects 


Winter projects 


Total 


1 - 2 weeks 


3 


0 


3 


3 weeks to 1 month 


5 


3 


8 


2 months 


4 


3 


7 


3-4 months 


2 


0 


2 


More than 4 months 


2 


2 


4 


Planning Is always going on 


0 


1 


1 


No formal planning during 
school year 


3 


0 


3 



Miscellaneous responses such 

as "sufficient," "varies each 1 5 6 

year," etc. 



For discussion, please see page 141. 
o 
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DATA SUMMARY 

Kinds of revisions made in current project compared to previous year (N * 33). 



Revision 


Summer projects 


Winter projects 


Total 


No revisions made 


3 


' 6 


9 


Made program more diversified 


5 


1 


6 


Personnel changes 


4 


1 


5 


Use of different curriculum 
and equipment 


3 


0 


3 


More grades served 


0 


2 


2 


Fewer subjects being included 


0 


2 


2 


Add teacher aides 


2 


0 


2 


Introduced new and/or different 
testing program 


2 


0 


2 


Serving fewer children 


1 


0 


1 



Other changes mentioned include: more home visits; Title I board to coordinate all pro* 
jects; different selection process; more parent involvement; and, change in evaluation 
' procedures. (For discussion, please see page 142.) 
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DATA SUMMARY 



Program objectives (N = 43). 



Program objectives specified 


Number of 
suirmer projects 


Number of 
winter projects 


Percentage of 
all projects 


Improve reading 


14 


7 


49% 


Improve self-image 


12 


6 


42% 


Improve verbal skills 


12 


5 


40% 


Raise general achievement levels 


5 


4 


21% 


Improve attitude toward school 


5 


4 


21% 


Improve performance in skill 
areas (unspecified) 


4 


4 


19% 


Increase expectation for success 
in school 


2 


5 


16% 


Improve attention span 


1 


6 


16% 


Improve math skills 


0 


6 


14% 


Develop non-verbal skills 


3 


2 


12% 


Provide individualized instruction 


3 


1 


9% 


Improve physical health 


0 


3 


7% 



NOTE; Projects may have more than one objective and most of them do; therefore, percentage 
column does not total 100%. 



(For discussion, please see page 159.) 
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DATA SUMMARY 

projects (necessary or having priority, 

but not sufficient). (Data come from 18 projects which used qualifications as listed.) 
See page 150 for discussion. 



Number of 



Number of 



Low economic status 
(deprived, disadvantaged) 


5 

2 (priority) 


2 


Younger or earlier grade 


1 


0 

1 (priority) 


Not a discipline problem, 
emotionally stable 


0 


1 


Parents receptive to program 


0 


1 


Student is a previous partici- 
pant in this or some other program 


0 

> (priority) 


0 


Attends target school 


3 

1 (priority) 


0 


Feels "out of it," a potential 
drop-out 


1 


0 


IQ in specified range 

Over 110 
90 - no 
80+ 

Not high 


2 

0 

1 

1 

1 


1 

1 

0 

0 

0 


Achievement test scores not high 


1 


0 


Of right age or sex to balance these 
factors in the program 


0 

1 (priority) 


0 


Will benefit from more individual 
attention 


0 


i 


Family large or one-parent 


0 

1 (priority) 


0 


A small number of normal achievers selected 
o 

:ric 


0 

1 (priority) 


0 
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DATA SUMMARY 



Selection of participants— criteria (necessary and sufficient). (Data are from 32 projects 
which specified such criteria.) 



Criteria 


Number of 


Number of 


summer projects 


winter projects 


POOR CLASSROOM PERFORMANCE 


5 


5 


In reading specifically 


1 


1 


In another specific area 


0 


1 


SPECIFIC NEED FOR SERVICE OFFERED 
SHOWN BY DIAGNOSIS 


1 (1 part) 


7 


In reading 


0 


3 


Specific learning disability 


0 


1 


Health problem or physical handicap 


0 


0 (1 part) 


Emotional or behavioral 


1 (1 part) 


0 


I.Q. IN SOME SPECIFIED RANGE 


2 


0 (1 part) 


Low, but not retarded 
Retarded 


2 


0 


0 


0 (1 part) 


LOW SCORE ON ACHIEVEMENT TEST 


8 


6 (1 part) 


Reading 


2 


2 


Underachiever (achievement 
below I.Q.) 


1 


2 (1 part) 


NON-ENGLISH SPEAKING 


0 (3 part) 


1 


OPEN TO ALL 


2 


0 



For discussion, please see page 163. 
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DATA SUMMARY 



participants-raethods of Identification used by projects. (Projects from 
which data were available = 29 out of 43.) ^ r u x . j 



Identification method 


Number of 
summer projects 


Number of 
winter projects 


RECOWENDATION OR REFERRAL BY 
SCHOOL PERSONNEL 


15 


7 


By teacher 


15 


7 


By principal 


2 


/ 

n 


By reading teacher 


1 


V 

1 

0 


By speech therapist 


2 


By staff psychologist 


3 


1 

0 


From a previous program 


1 


By guidance person 


1 


1 


REFERRALS FROM OUTSIDE SCHOOL 


6 


1 


By probation officer 


1 


0 


By welfare worker 


1 


\J 

n 


By social work agency 


1 


u 

1 

0 


By psychiatrist 


0 


By employment service 


0 


1 

1 


By physician 


0 


DIAGNOSTIC TESTING 


1 


6 


Reading 


0 


2 


Intelligence 


1 


0 


Achievement test used as diagnostic 


0 


1 


ACHIEVEMENT TEST SCORES LOW 


3 


2 


Reading test 


0 


2 


Ability or skills test 


1 


0 




a;i3 



Identification method 


Number of 
summer projects 


Number of 
winter projects 


INTERVIEWS WITH STUDENTS 


0 


1 


OBSERVATION OF STUDENTS 


1 


1 


PAST RECORD 


1 


1 


ANECDOTAL RECORDS 


1 


0 



NOTE: Response categories which subsume other responses may not equal the sum of responses 

to the sub-categories because a project representing more than one sub-category was 
counted only once for the category. Furthermore, there were some responses indicat- 
ing a main category without specifying the sub-category. 



o 
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DATA SUMMARY 

Evaluation designs used* (projects from which data were available = 37 out of 43). 



Type of Design 


Summer projects 


Winter projects 


Totals** 


0X0 


12 

(plus part of 
one project) 


5 

(plus part of 
one project) 


17+ 


No evaluation design 


8 


8 


16 


0 X 0 X 0 X 0 
(Repeated observations 
within one year) 


1 


2 


3 


0X0 

(Pre-test, post-test 
with control group, 0 0) 


1 


0 


1 


X 0 (Post-test only) 


1 


0 


1 


0 X 0 X 0 X (Repeated ob- 
servations year to year) 


0 


1 


1 


0 X (Pre-test only) 


Part of one project 


0 


0+ 



* See footnote on page 168 for explanation of code representation of design type. 

** This column does not total 37 since some projects employed a combination of designs 
and are therefore represented more than once. 

For discussion* please see page 170. * 
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DATA SUMMARY 



Number and percentage of projects in the sample which included comparison as well as 
treatment groups (N = 38 out of 43). 



Item under consideration 


Number of 
projects 


Percentage of 
projects exclu- 
sive of those 
for which ade- 
quate data were 
not available 


Number of 
projects 
for which 
data were 
not avail- 
able 

i 


Number of 
projects 
for which 
these items 
are inappli- 
cable 




S and W* 


S and W 


S and W 


S and W 


No, did not in- 
clude comparison 
group 


37 


97% 


5 


0 


Yes, did include 
comparison group 


1 


3% 


5 


0 



* S and W = Summer and winter projects 
Please see page 171 for discussion. 



o 
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DATA SUMMARY 



Standardized tests used in project evaluations (projects from which data were available = 
41 out of 43). 



As part of Given to 

regular all stu- 

testing dents in 

program* program 



Given only 
to some 
students 
in program 



Type of test 


S 


w 


S 


w 


s 


w 


ACHIEVEMENT BATTERIES 


4 


7 


6 


3 


3 


2 


Stanford Achievement 


1 


2 


1 


1 


1 


0 


SRA Achievement Series 


0 


3 


1 


2 


0 


0 


Iowa Tests of Educational Development (gr. 9+) 


0 


1 


0 


0 


0 


0 


Iowa Test of Basic Skills (gr. 3-9) 


0 


2 


1 


0 


0 


0 


California Achievement Tests 


1 


0 


1 


0 


0 


1 


Metropolitan Achievement Tests 


2 


0 


1 


0 


1 


1 


Unidentifi ed 


1 


0 


1 


0 


0 


0 


MATHEMATICS ACHIEVEMENT TESTS 


0 


0 


0 


0 


1 


0 


Lankton First Year Algebra Test 


0 


0 


0 


0 


1 


0 


Schorl ing Arithmetic 


0 


0 


0 


0 


1 


0 


Snader General Mathematics Test 


0 


0 


0 


0 


1 


0 


SPELLING TESTS 


0 


0 


0 


1 


0 


0 


Morrison-McCall Spelling Test 


0 


0 


0 


1 


0 


0 


READING ACHIEVEMENT TESTS 


0 


2 


3 


1 


0 


0 


Iowa Si Vent Reading Tests 


0 


0 


0 


1 


0 


0 



Though tests may 
necessarily mean 
o 

ERIC 



have been given as part of a 
that data were used in Title 



given school's testing 
I project evaluation. 



program, this does not 
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As part of Given to Given only 

regular all stu- to some 

testing dents in students 

program program in program 



Type of test 


S 


w 


S 


w 


s 


w 


Nelson Reading Test 


0 


1 


0 


0 


0 


0 


California Reading Tests (sub-test of CAT) 


0 


1 


0 


0 


0 


0 


Stanford Reading Tests (sub-test of SAT) 


0 


0 


2 


0 


0 


0 


Houghton-Miffl in Reading Program Tests 


0 


0 


1 


0 


0 


0 


Gates-MacGintie Reading Tests 


0 


0 


1 


0 


0 


0 


DIAGNOSTIC READING TESTS 


0 


1 


4 


2 


0 


4 


Diagnostic Reading Scales (George Sprache) 


0 


0 


0 


1 


0 


1 


Lyons and Carnahan New Developmental Reading Test 


0 


1 


0 


0 


0 


0 


Gates-McKillop Reading Diagnostic Tests 


0 


0 


1 


0 


0 


2 


Cooper Diagnostic Reading Test 


0 


0 


1 


0 


0 


0 


Total Comprehension Test 


0 


0 


1 


0 


0 


0 


McCullough Word Analysis Tests 


0 


0 


0 


1 


0 


0 


Dolch Sight Word Test 


0 


0 


1 


0 


0 


0 


Durrell Analysis of Reading Difficulties 


0 


0 


0 


0 


0 


1 


ORAL READING TESTS 


0 


0 


0 


3 


0 


1 


Gray Oral Reading Tests 


0 


0 


0 


2 


0 


1 


Gilmore Oral Reading Test 


0 


0 


0 


1 


0 


0 


READING READINESS TESTS 


0 


4 


0 


3 


0 


2 


American School Reading Readiness Test 


0 


0 


0 


1 


0 


1 


Metropolitan Reading Readiness 


0 


4 


0 


1 


0 


0 
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As part of 
regular 
testing 
program 



Given to 
all stu- 
dents in 
program 



Given only 
to some 
students 
in program 



Type of test 


s 


w 


s 


w 


s 


w 


Maturity Level for School Entrance and 














Reading Readiness 


0 


0 


0 


1 


0 


0 


The Pre-Reader 


0 


0 


0 


0 


0 


1 


MISCELLANEOUS READING TESTS 


0 


0 


1 


0 


0 


1 


Botel Reading Inventory 


0 


0 


1 


0 


0 


0 


Durrell -Sullivan Reading Capacity 


0 


0 


0 


0 


0 


1 


GROUP INTELLIGENCE TESTS 


2 


3 


2 


1 


2 


4 


Goodenough Draw-a-Person Test 


0 


0 


0 


0 


1 


3 


Otis Lennon 


0 


0 


0 


0 


1 


0 


Pintner-Durost Test of General Ability 


0 


1 


0 


0 


0 


0 


Kuhlman-Anderson 


1 


0 


0 


0 


0 


0 


Otis Gamma 


0 


0 


0 


0 


1 


w 

0 


Lorge-Thorndike Intelligence Test 


2 


2 


2 


0 


1 


0 


Pintner-Cunningham Primary Test 


0 


1 


0 


0 


0 


0 


California Test of Mental Maturity 


0 


1 


0 


0 


0 


0 


Otis Quick-scoring Test of Mental Ability 


0 


0 


0 


1 


0 


0 


IPAT Culture-Fair Intelligence Test 


0 


0 


0 


0 


0 


1 


INDIVIDUAL INTELLIGENCE 


1 


0 


0 


1 


1 


5 


Peabody Picture Vocabul aryTes t 


0 


0 


0 


1 


0 


1 


Slosson's Quick-Scoring IQ Test 


1 


0 


0 


0 


0 


0 


Stanford Binet 


0 


0 


0 


0 


0 


3 


Wechsler Intelligence Scale for Children 


0 


0 


0 


1 


1 


3 


o 
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As part of Given to 
regular all sta- 
tes ting dents in 
program program 



Given only 
to some 
students 
in program 



Type of test 


S 


w 


s 


w 


s 


w 


PERCEPTION 


0 


1 


0 


1 


0 


3 


Berea-Gestalt Form Test 


0 


0 


0 


0 


0 


1 


Frostig Test of Visual Perception 


0 


1 


0 


0 


0 


1 


Bender Gestalt 


0 


1 


0 


1 


0 


2 


Wepman Auditory 


0 


1 


0 


0 


0 


1 


Slingerland 


0 


0 


0 


0 


0 


1 


MOTOR PROFICIENCY 


0 


0 


0 


0 


0 


1 


Purdue Motor Survey 


0 


0 


0 


0 


0 


1 


CHARACTER— PROJECTIVE 


0 


0 


0 


0 


0 


1 


Thematic Apperception Test 


0 


0 


0 


0 


0 


1 


CHARACTER— NONPROJECTIVE (other than behavioral 
development scales) 


0 


0 


1 


0 


1 


1 


California Test of Personality 


0 


0 


0 


0 


0 


1 


Social and Emotional Behavior Test 


0 


0 


1 


0 


0 


0 


Demos -D 


0 


0 


0 


0 


1 


0 


BEHAVIORAL DEVELOPMENT SCALES 


0 


0 


0 


2 


0 


0 


Vineland Social Maturity Scale 


0 


0 


0 


1 


0 


0 


Developmental Behavior Test of Ilg and Ames 


0 


0 


0 


1 


0 


0 


Cain-Levine Social Competency Scale 


0 


0 


0 


1 


0 


0 
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As part of 
regular 
testing 
program 



Given to 
all stu- 
dents in 
program 



Given only 
to some 
students 
in program 



Type of test 


S 


W 


s 


w 


s 


w 


CLASSROOM OBSERVATION PROTOCOLS 


0 


0 


0 


0 


1 


0 


Garfunkel 's CRB Scale 


0 


0 


0 


0 


1 


0 


VOCATIONAL PREFERENCE TESTS 


0 


1 


0 


0 


0 


0 


Kuder Preference Test 


0 


1 


0 


0 


0 


0 


TEST OF TEACHER ATTITUDES 


0 


0 


1 


0 


0 


0 


Minnesota Teacher Attitude Inventory 


0 


0 


1 


0 


0 


0 


STUDENT ATTITUDE QUESTIONNAIRES 


0 


0 


1 


0 


0 


0 


SRA Attitude Questionnaire 


0 


0 


1 


0 


0 


0 



(For discussion, please see page 175.) 



NOTE: Response categories which subsume other responses may not equal the sum of responses to 

the sub-categories because a project representing more than one sub-category was counted 
only once for the category. Furthermore, there were some responses indicating a main 
category without specifying the sub-category. 
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DATA SUMMARY 

Statistical treatments used by projects in analyzing project data (N = 36 out of 43). 

Percentage of pro- 



Statistical Treatment 


Number of projects 
from which data were 
available 


jects exclusive of 
those from which data 
were not available 




S and W* 


S and W 


None (includes responses 
of no data) 


22 


61% 


Computed gain scores in 
terms of grade equiva- 
lencies 


10 


27% 


Sample graphs plotted, etc. 
(but no real analysis) 


3 


8% 


Co-variate analysis for 
comparison with control 
group (Boston) 


1 


4% 



* S and W = Summer and winter projects 
Please see page 183 for discussion. 
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DATA SUMMARY 

Feedback mechanism for program modification (N = 43). 



Item under consideration 


Number of projects 
from which data were 
available 


Percentage of pro- 
jects exclusive of 
those from which data 
were not available 




S and W* 


S and W 


No feedback mechanism 


20 


47% 


Staff meetings, but practically 
no discussion on feedback for 
program modification 


4 


9% 


Informal feedback (discussion 
and/or conversation) 


5 


12% 


Weekly or regular staff meetings 


14 


32% 


TOTALS 


43 


100% 



* S and W = Summer and winter projects 



Sge page 194 for discussion. 
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DATA SUMMARY 



Background, training, and utilization of teacher aides. 



Percentage of projects 
in sample exclusive of 
Number of projects those from which data 

with characteristics were not available or 



Characteristic 


as outlined 




applicable 




S* 


W** 


S and W 


BACKGROUND 


Some college education 


0 


1 


6% 


College students 


6 


0 


33% 


High School students 


2 


0 


m 


Housewi ves 


2 


3 


28% 


Neighborhood of school 


5 


1 


33% 


(Above categories are not 


mutually exclusive) 






(N = 18) 


DUTIES 


Clerical 


6 


2 


m 


Housekeeping 


2 


2 


22% 


Assisting with instruction 


9 


4 


76% 


(Above categories are not 


mutually exclusive) 






(N = 18) 


TRAINING 


None 


3 


4 


47% 


Pre-service for this project 


2 


3 


33% 


College or university connected 




n 


OM 


training 








(N = 15) 



* S = SuRiner projects 
= Winter projects 

See page 209 for discussion. 
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